Nov 28 13:48:43 user devstack@n-api.service[65024]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 28 13:48:43 user devstack@n-api.service[65024]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Nov 28 13:48:43 2023] *** Nov 28 13:48:43 user devstack@n-api.service[65024]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 28 13:48:43 user devstack@n-api.service[65024]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 28 13:48:43 user devstack@n-api.service[65024]: nodename: user Nov 28 13:48:43 user devstack@n-api.service[65024]: machine: x86_64 Nov 28 13:48:43 user devstack@n-api.service[65024]: clock source: unix Nov 28 13:48:43 user devstack@n-api.service[65024]: pcre jit disabled Nov 28 13:48:43 user devstack@n-api.service[65024]: detected number of CPU cores: 12 Nov 28 13:48:43 user devstack@n-api.service[65024]: current working directory: / Nov 28 13:48:43 user devstack@n-api.service[65024]: detected binary path: /usr/bin/uwsgi-core Nov 28 13:48:43 user devstack@n-api.service[65024]: your processes number limit is 63589 Nov 28 13:48:43 user devstack@n-api.service[65024]: your memory page size is 4096 bytes Nov 28 13:48:43 user devstack@n-api.service[65024]: detected max file descriptor number: 2048 Nov 28 13:48:43 user devstack@n-api.service[65024]: lock engine: pthread robust mutexes Nov 28 13:48:43 user devstack@n-api.service[65024]: thunder lock: enabled Nov 28 13:48:43 user devstack@n-api.service[65024]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 28 13:48:43 user devstack@n-api.service[65024]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] Nov 28 13:48:43 user devstack@n-api.service[65024]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 28 13:48:43 user devstack@n-api.service[65024]: Set PythonHome to /opt/stack/data/venv Nov 28 13:48:43 user devstack@n-api.service[65024]: Python main interpreter initialized at 0x564218750b90 Nov 28 13:48:43 user devstack@n-api.service[65024]: python threads support enabled Nov 28 13:48:43 user devstack@n-api.service[65024]: your server socket listen backlog is limited to 100 connections Nov 28 13:48:43 user devstack@n-api.service[65024]: your mercy for graceful operations on workers is 80 seconds Nov 28 13:48:43 user devstack@n-api.service[65024]: mapped 537436 bytes (524 KB) for 3 cores Nov 28 13:48:43 user devstack@n-api.service[65024]: *** Operational MODE: preforking *** Nov 28 13:48:43 user devstack@n-api.service[65024]: *** uWSGI is running in multiple interpreter mode *** Nov 28 13:48:43 user devstack@n-api.service[65024]: spawned uWSGI master process (pid: 65024) Nov 28 13:48:43 user devstack@n-api.service[65024]: spawned uWSGI worker 1 (pid: 65025, cores: 1) Nov 28 13:48:43 user devstack@n-api.service[65024]: spawned uWSGI worker 2 (pid: 65026, cores: 1) Nov 28 13:48:43 user devstack@n-api.service[65024]: spawned uWSGI worker 3 (pid: 65027, cores: 1) Nov 28 13:48:43 user devstack@n-api.service[65024]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 13:48:47 user devstack@n-api.service[65026]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 13:48:47 user devstack@n-api.service[65026]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 13:48:47 user devstack@n-api.service[65026]: and ``live_migration_inbound_addr`` respectively. Nov 28 13:48:47 user devstack@n-api.service[65026]: ). Its value may be silently ignored in the future. Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 13:48:47 user devstack@n-api.service[65027]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 13:48:47 user devstack@n-api.service[65027]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 13:48:47 user devstack@n-api.service[65027]: and ``live_migration_inbound_addr`` respectively. Nov 28 13:48:47 user devstack@n-api.service[65027]: ). Its value may be silently ignored in the future. Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 13:48:47 user devstack@n-api.service[65025]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 13:48:47 user devstack@n-api.service[65025]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 13:48:47 user devstack@n-api.service[65025]: and ``live_migration_inbound_addr`` respectively. Nov 28 13:48:47 user devstack@n-api.service[65025]: ). Its value may be silently ignored in the future. Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65027) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65025) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 13:48:47 user devstack@n-api.service[65026]: INFO dbcounter [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Registered counter for database nova_api Nov 28 13:48:47 user devstack@n-api.service[65027]: INFO dbcounter [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Registered counter for database nova_api Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_db.sqlalchemy.engines [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writer thread running {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65025]: INFO dbcounter [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Registered counter for database nova_api Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writer thread running {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_db.sqlalchemy.engines [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writer thread running {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG nova.context [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4cfc4cc-712b-461a-95da-c44375c58fac(cell1) {{(pid=65027) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG nova.context [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4cfc4cc-712b-461a-95da-c44375c58fac(cell1) {{(pid=65026) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:48:47 user devstack@n-api.service[65027]: INFO dbcounter [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Registered counter for database nova_cell0 Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:48:47 user devstack@n-api.service[65027]: INFO dbcounter [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Registered counter for database nova_cell1 Nov 28 13:48:47 user devstack@n-api.service[65026]: INFO dbcounter [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Registered counter for database nova_cell0 Nov 28 13:48:47 user devstack@n-api.service[65026]: INFO dbcounter [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Registered counter for database nova_cell1 Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG nova.context [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4cfc4cc-712b-461a-95da-c44375c58fac(cell1) {{(pid=65025) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_db.sqlalchemy.engines [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writer thread running {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65025]: INFO dbcounter [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Registered counter for database nova_cell0 Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65025]: INFO dbcounter [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Registered counter for database nova_cell1 Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writer thread running {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_db.sqlalchemy.engines [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writer thread running {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_db.sqlalchemy.engines [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_db.sqlalchemy.engines [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writer thread running {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writer thread running {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65027]: INFO dbcounter [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Registered counter for database nova_cell0 Nov 28 13:48:47 user devstack@n-api.service[65026]: INFO dbcounter [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Registered counter for database nova_cell0 Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG oslo_db.sqlalchemy.engines [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writer thread running {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writer thread running {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writer thread running {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:47 user devstack@n-api.service[65025]: INFO dbcounter [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Registered counter for database nova_cell0 Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG oslo_db.sqlalchemy.engines [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 13:48:47 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writer thread running {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 13:48:48 user devstack@n-api.service[65026]: WARNING keystonemiddleware.auth_token [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 13:48:48 user devstack@n-api.service[65026]: WARNING keystonemiddleware.auth_token [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 13:48:48 user devstack@n-api.service[65027]: WARNING keystonemiddleware.auth_token [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 13:48:48 user devstack@n-api.service[65027]: WARNING keystonemiddleware.auth_token [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 13:48:48 user devstack@n-api.service[65025]: WARNING keystonemiddleware.auth_token [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 13:48:48 user devstack@n-api.service[65025]: WARNING keystonemiddleware.auth_token [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 13:48:48 user devstack@n-api.service[65026]: WARNING keystonemiddleware.auth_token [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 13:48:48 user devstack@n-api.service[65026]: WARNING keystonemiddleware.auth_token [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 13:48:48 user devstack@n-api.service[65026]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564218750b90 pid: 65026 (default app) Nov 28 13:48:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:48:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001547 Nov 28 13:48:48 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Nov 28 13:48:48 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:48:48 user devstack@n-api.service[65027]: WARNING keystonemiddleware.auth_token [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 13:48:48 user devstack@n-api.service[65027]: WARNING keystonemiddleware.auth_token [None req-215558c0-5d72-4840-bcb0-3a06d08409ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 13:48:48 user devstack@n-api.service[65027]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564218750b90 pid: 65027 (default app) Nov 28 13:48:48 user devstack@n-api.service[65025]: WARNING keystonemiddleware.auth_token [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 13:48:48 user devstack@n-api.service[65025]: WARNING keystonemiddleware.auth_token [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 13:48:48 user devstack@n-api.service[65025]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564218750b90 pid: 65025 (default app) Nov 28 13:50:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:50:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7a1e3bbb-5f2d-45ed-b785-ba672457d8e8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001538 Nov 28 13:50:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:50:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:50:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:50:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:50:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:50:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:50:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-98173368-36d4-46ab-b1ea-8d730700cf4d admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:50:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-98173368-36d4-46ab-b1ea-8d730700cf4d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.363028 Nov 28 13:50:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 13:50:59 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:01 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.004968 Nov 28 13:51:01 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:01 2023] GET /compute/v2.1 => generated 387 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7b294c3b-c269-47ed-8e95-a0bf805aeaad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7b294c3b-c269-47ed-8e95-a0bf805aeaad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.347444 Nov 28 13:51:02 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:01 2023] POST /compute/v2.1/flavors => generated 405 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a035a7dc-a064-430b-8b31-b7c28402a7b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a035a7dc-a064-430b-8b31-b7c28402a7b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051916 Nov 28 13:51:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 13:51:02 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:03 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001297 Nov 28 13:51:03 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-edd13010-c95c-46fb-a5b8-7ecf4f96ded8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-edd13010-c95c-46fb-a5b8-7ecf4f96ded8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.091084 Nov 28 13:51:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f2f1ecb4-d2fc-4b38-b51b-a85071c412e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f2f1ecb4-d2fc-4b38-b51b-a85071c412e1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032654 Nov 28 13:51:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 13:51:04 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001451 Nov 28 13:51:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-61c84b00-486a-433b-9f44-b5b76bc2c72d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-61c84b00-486a-433b-9f44-b5b76bc2c72d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068699 Nov 28 13:51:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:06 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ee0c78e5-2882-4455-9eb1-ab9aa9655543 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ee0c78e5-2882-4455-9eb1-ab9aa9655543 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025224 Nov 28 13:51:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 13:51:06 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001315 Nov 28 13:51:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-971a107c-be78-47c0-b246-b5e504974569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-971a107c-be78-47c0-b246-b5e504974569 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063868 Nov 28 13:51:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:08 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3fb00cb7-9a80-4e54-bd03-de06303edc7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3fb00cb7-9a80-4e54-bd03-de06303edc7e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024508 Nov 28 13:51:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 13:51:08 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:10 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:10 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001400 Nov 28 13:51:10 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:10 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-57fa9537-3a3b-4e54-b55b-3424ef115933 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-57fa9537-3a3b-4e54-b55b-3424ef115933 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069229 Nov 28 13:51:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:10 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024112 Nov 28 13:51:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 13:51:10 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:12 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:12 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5819cec4-198a-4465-afc5-31e47217dc57 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001314 Nov 28 13:51:12 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:12 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ba355c75-a8db-48d6-8bc1-adea0298bea6 admin admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ba355c75-a8db-48d6-8bc1-adea0298bea6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.074036 Nov 28 13:51:12 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 13:51:12 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:51:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001528 Nov 28 13:51:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:14 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-44e77a3b-4d72-483d-8950-f2aabbacaa2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-44e77a3b-4d72-483d-8950-f2aabbacaa2b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.309867 Nov 28 13:51:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:14 2023] POST /compute/v2.1/flavors => generated 400 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d37cb059-28e2-46f4-8e6d-cdc99879bdea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d37cb059-28e2-46f4-8e6d-cdc99879bdea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038363 Nov 28 13:51:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 13:51:14 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001304 Nov 28 13:51:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f5361e08-fcf8-4e4c-a359-34593bfc1961 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f5361e08-fcf8-4e4c-a359-34593bfc1961 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066192 Nov 28 13:51:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:16 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:17 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-bbc31b7f-e0d3-42b5-af5b-6be8e72e4640 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-bbc31b7f-e0d3-42b5-af5b-6be8e72e4640 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026030 Nov 28 13:51:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 13:51:17 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001288 Nov 28 13:51:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-86e12c0e-0df4-447d-869c-2ff137ca4609 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "disk": 40, "vcpus": 2, "id": "3"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-86e12c0e-0df4-447d-869c-2ff137ca4609 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060931 Nov 28 13:51:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:18 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:19 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e2fab3c5-6c57-496f-b894-e559391be4c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e2fab3c5-6c57-496f-b894-e559391be4c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028636 Nov 28 13:51:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 13:51:18 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001340 Nov 28 13:51:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1ff10871-48ed-4fc9-9f0b-9bcb5ee9b95d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1ff10871-48ed-4fc9-9f0b-9bcb5ee9b95d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062251 Nov 28 13:51:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:20 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:21 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f7bbceda-bb17-462c-9d45-a15116508ed7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:21 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f7bbceda-bb17-462c-9d45-a15116508ed7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026239 Nov 28 13:51:21 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 13:51:21 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001332 Nov 28 13:51:22 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 13:51:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:23 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-46f8e0f2-d96c-4f78-ad0b-101a6d949bae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-46f8e0f2-d96c-4f78-ad0b-101a6d949bae admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073219 Nov 28 13:51:23 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 13:51:23 2023] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:51:23 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3d400387-0f39-4320-85d4-7e3f024d491d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:51:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3d400387-0f39-4320-85d4-7e3f024d491d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027519 Nov 28 13:51:23 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 13:51:23 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:51:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1e4e232c-f583-4075-8254-d8013be8383e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001522 Nov 28 13:51:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 13:51:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:51:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:51:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.185745 Nov 28 13:51:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Tue Nov 28 13:51:55 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:52:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3d400387-0f39-4320-85d4-7e3f024d491d admin admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:52:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3d400387-0f39-4320-85d4-7e3f024d491d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001942 Nov 28 13:52:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 13:52:25 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:52:25 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:52:25 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-850ff131-8352-447a-bca3-d1eacd108f17 admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:52:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-850ff131-8352-447a-bca3-d1eacd108f17 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068905 Nov 28 13:52:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Tue Nov 28 13:52:25 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:52:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:52:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-aee27094-b10d-4eab-9169-856ec675a3c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001980 Nov 28 13:52:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 13:52:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:52:28 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:52:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a67d9aac-026b-44ef-98ce-aa27c68465d7 admin admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:52:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a67d9aac-026b-44ef-98ce-aa27c68465d7 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.065799 Nov 28 13:52:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 13:52:28 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:52:30 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-850ff131-8352-447a-bca3-d1eacd108f17 admin admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:52:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-850ff131-8352-447a-bca3-d1eacd108f17 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002103 Nov 28 13:52:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 13:52:30 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:52:30 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:52:30 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:52:30 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:52:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5a695594-3f3c-4a25-9077-ef79d18610f0 admin admin] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:52:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5a695594-3f3c-4a25-9077-ef79d18610f0 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.082669 Nov 28 13:52:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 13:52:30 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:55:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ebefcead-35e4-4af3-aeb0-203ffb7b144e tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: .version_select at 0x7fedf144b640>, body: {"keypair": {"name": "tempest-keypair-605550184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:00 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-ebefcead-35e4-4af3-aeb0-203ffb7b144e tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:00 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-ebefcead-35e4-4af3-aeb0-203ffb7b144e tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for user c38a4b08cd204e2a9b313a7740df3f3e and project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ebefcead-35e4-4af3-aeb0-203ffb7b144e tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.333592 Nov 28 13:55:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 16/44] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:55:00 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-84e339cc-043e-4753-8288-7a4e924c6973 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Action: 'create', calling method: .version_select at 0x7fedf154b9a0>, body: {"keypair": {"name": "tempest-keypair-2095208703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:03 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-84e339cc-043e-4753-8288-7a4e924c6973 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting quotas for project d326de84f8224cef95e650bd92e7198f. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:03 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-84e339cc-043e-4753-8288-7a4e924c6973 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting quotas for user 14da9954e4fc44deb3c603165b10cf66 and project d326de84f8224cef95e650bd92e7198f. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-84e339cc-043e-4753-8288-7a4e924c6973 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239969 Nov 28 13:55:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 15/45] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:55:03 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:05 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1356482257", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "73322956-2161-4c75-88f6-ddf480017fbe"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:06 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] validate_networks() for [('73322956-2161-4c75-88f6-ddf480017fbe', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1751161168", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "44d4bd64-355a-4f2d-a009-466966959f54"}], "security_groups": [{"name": "tempest-securitygroup--2080308110"}], "key_name": "tempest-keypair-605550184", "user_data": "}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:06 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] validate_networks() for [('44d4bd64-355a-4f2d-a009-466966959f54', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Getting quotas for project 0f9642956daa4507a3b6791bcd41d9d3. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Getting quotas for user 237e50c8ccfa49169a1bdca99f46e616 and project 0f9642956daa4507a3b6791bcd41d9d3. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.314190 Nov 28 13:55:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:55:07 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-20f854d2-d118-4026-ac78-c6fcd53da086 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:07 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-20f854d2-d118-4026-ac78-c6fcd53da086 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for user c38a4b08cd204e2a9b313a7740df3f3e and project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:07 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.974353 Nov 28 13:55:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:06 2023] POST /compute/v2.1/servers => generated 400 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:55:08 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-20f854d2-d118-4026-ac78-c6fcd53da086 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0377a010-cf4b-403b-b790-10282c210354 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:08 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0377a010-cf4b-403b-b790-10282c210354 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-20f854d2-d118-4026-ac78-c6fcd53da086 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1209 microversion: 2.1 time: 0.485436 Nov 28 13:55:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:07 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1209 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:08 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-0377a010-cf4b-403b-b790-10282c210354 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0377a010-cf4b-403b-b790-10282c210354 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1229 microversion: 2.1 time: 0.172533 Nov 28 13:55:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:08 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-370204766", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "a4074972-6f6c-4057-aaf4-84820b2e0c57"}], "security_groups": [{"name": "tempest-securitygroup--1506725747"}], "key_name": "tempest-keypair-2095208703", "user_data": "}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:10 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] validate_networks() for [('a4074972-6f6c-4057-aaf4-84820b2e0c57', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting quotas for project d326de84f8224cef95e650bd92e7198f. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting quotas for user 14da9954e4fc44deb3c603165b10cf66 and project d326de84f8224cef95e650bd92e7198f. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:11 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.761281 Nov 28 13:55:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 18/50] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:09 2023] POST /compute/v2.1/servers => generated 407 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:55:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-802be02c-4a8c-4e58-9d2d-adc91057e79d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:11 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-802be02c-4a8c-4e58-9d2d-adc91057e79d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:11 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d17841bb-c4b6-4b71-a027-800772e99aca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: .version_select at 0x7fedf14e7ac0>, body: {"keypair": {"name": "tempest-keypair-2064566278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEurKFzowQcp2NLIRyfnyakH2lqBVHuoHwmKYo7DloY5HmCUCDn4ZANWNR9sovmCPmqCPQf1ocz3QVX5DnNCT72PukED7dIYoq4XGJEjcy1YchSPVrm0tfF5cMKIzfF5ug=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:11 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d17841bb-c4b6-4b71-a027-800772e99aca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:11 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d17841bb-c4b6-4b71-a027-800772e99aca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:11 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d17841bb-c4b6-4b71-a027-800772e99aca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.235485 Nov 28 13:55:11 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:55:11 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:11 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-802be02c-4a8c-4e58-9d2d-adc91057e79d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-802be02c-4a8c-4e58-9d2d-adc91057e79d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1232 microversion: 2.1 time: 0.157115 Nov 28 13:55:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:11 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1232 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dd0221-4935-4ee2-9958-90a748fe5255", "tag": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:15 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Creating event network-changed:ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance 48dd0221-4935-4ee2-9958-90a748fe5255 on user Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=65026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:15 user devstack@n-api.service[65026]: INFO nova.compute.rpcapi [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 13:55:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] Releasing lock "compute-rpcapi-router" {{(pid=65026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 13:55:15 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ea34f958-5153-46d8-adcd-9cbdb66a5b95 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.334497 Nov 28 13:55:15 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 19/53] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Creating event network-changed:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65027) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Acquired lock "compute-rpcapi-router" {{(pid=65027) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:17 user devstack@n-api.service[65027]: INFO nova.compute.rpcapi [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 13:55:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] Releasing lock "compute-rpcapi-router" {{(pid=65027) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 13:55:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-fe64bd11-6840-479a-b839-dd9206b61442 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090011 Nov 28 13:55:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 18/54] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-462278016", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7"}], "security_groups": [{"name": "tempest-securitygroup--1535552609"}], "key_name": "tempest-keypair-2064566278", "user_data": "}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:18 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] validate_networks() for [('eb697d01-87f7-4768-84bb-0e25fdf0c3e7', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-64a2916d-a738-49bc-9537-7656fcefe895 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Action: 'create', calling method: .version_select at 0x7fedf13e4b80>, body: {"keypair": {"name": "tempest-keypair-776308576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJBP38LrSeECryJxQCpE/WiHIW+aDF65IhTudWGMrLGYW0xa/psYC/7M2yDVYu5HJRMMQSALCu3mXia21ivoTFH56dqp27J4aTQ35ItkZ8oC2jGFWLCbfMiEmkHahxHTQ=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:18 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-64a2916d-a738-49bc-9537-7656fcefe895 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting quotas for project 75b572682eb94af0b628ee30a16d9225. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:18 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-64a2916d-a738-49bc-9537-7656fcefe895 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting quotas for user c9f9b1cc04a4417ebf987aa99a18e6a7 and project 75b572682eb94af0b628ee30a16d9225. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-64a2916d-a738-49bc-9537-7656fcefe895 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251453 Nov 28 13:55:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:55:18 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:19 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Creating event network-changed:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:55:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028456 Nov 28 13:55:19 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 19/56] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:20 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.346919 Nov 28 13:55:20 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 18/57] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 13:55:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3a333907-7b46-481f-9a48-92e1669abb86 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:20 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3a333907-7b46-481f-9a48-92e1669abb86 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:20 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-3a333907-7b46-481f-9a48-92e1669abb86 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3a333907-7b46-481f-9a48-92e1669abb86 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 200 len: 1233 microversion: 2.1 time: 0.178680 Nov 28 13:55:20 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 21/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:20 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 1233 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:21 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:21 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2036539272", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "efa0e0e2-5675-40e1-9d88-b46b666489be"}], "security_groups": [{"name": "tempest-securitygroup--602002634"}], "key_name": "tempest-keypair-776308576", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:22 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] validate_networks() for [('efa0e0e2-5675-40e1-9d88-b46b666489be', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting quotas for project 75b572682eb94af0b628ee30a16d9225. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting quotas for user c9f9b1cc04a4417ebf987aa99a18e6a7 and project 75b572682eb94af0b628ee30a16d9225. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:24 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:24 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.495227 Nov 28 13:55:24 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:55:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fdc3b7a0-4040-4f96-b353-947f0939157b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:24 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fdc3b7a0-4040-4f96-b353-947f0939157b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:24 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-fdc3b7a0-4040-4f96-b353-947f0939157b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fdc3b7a0-4040-4f96-b353-947f0939157b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6" status: 200 len: 1233 microversion: 2.1 time: 0.114653 Nov 28 13:55:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 19/60] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:24 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6 => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949a3612-5042-420f-9911-ec641017d399", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Creating event network-changed:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 13:55:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128689 Nov 28 13:55:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 22/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd0221-4935-4ee2-9958-90a748fe5255", "name": "network-vif-plugged", "status": "completed", "tag": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Creating event network-vif-plugged:ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance 48dd0221-4935-4ee2-9958-90a748fe5255 on user Nov 28 13:55:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212168 Nov 28 13:55:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd0221-4935-4ee2-9958-90a748fe5255", "name": "network-vif-plugged", "status": "completed", "tag": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Creating event network-vif-plugged:ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance 48dd0221-4935-4ee2-9958-90a748fe5255 on user Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Acquired lock "compute-rpcapi-router" {{(pid=65025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:28 user devstack@n-api.service[65025]: INFO nova.compute.rpcapi [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 13:55:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] Releasing lock "compute-rpcapi-router" {{(pid=65025) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 13:55:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-74564a1d-0064-4abf-b162-fe63878fc8c5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176645 Nov 28 13:55:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 20/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:33 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=22 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Creating event network-changed:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 13:55:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124084 Nov 28 13:55:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:35 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:35 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:35 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:55:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065716 Nov 28 13:55:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 22/65] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=18 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:37 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-caa1bde9-8e71-440e-8144-88986315248a tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Action: 'create', calling method: .version_select at 0x7fedf13e57e0>, body: {"keypair": {"name": "tempest-keypair-1885537121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:55:37 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-caa1bde9-8e71-440e-8144-88986315248a tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Getting quotas for project 0eb964406b0844ce997488844a2b0676. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105176 Nov 28 13:55:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 21/66] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:55:37 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-caa1bde9-8e71-440e-8144-88986315248a tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Getting quotas for user c126fcfb0e4747ccaaf814d508698c55 and project 0eb964406b0844ce997488844a2b0676. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:37 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-caa1bde9-8e71-440e-8144-88986315248a tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.127031 Nov 28 13:55:37 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 24/67] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 13:55:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 13:55:39 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1ca6b011-1f44-4b10-946b-8e8ad8fe6491 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Action: 'create', calling method: .version_select at 0x7fedf139fc70>, body: {"keypair": {"name": "tempest-keypair-888199441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWrRYCdiugZ/CtrXqVD7eb5gUF2aQeZcK+0n7VM+NPSH+J/LVpNX8a1nsI34ZJBupBnzclrmU9wWLa+aW6mmPWCfOw3jkfYnl2HBeR1euPFYe3X7kvXFSQTwgf/TwJkNA=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:39 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-1ca6b011-1f44-4b10-946b-8e8ad8fe6491 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Getting quotas for project b65587be998440ed8f615dcb2f8f0d97. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:39 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-1ca6b011-1f44-4b10-946b-8e8ad8fe6491 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Getting quotas for user ecf1fd2414db4fb9a5006cc8f5441745 and project b65587be998440ed8f615dcb2f8f0d97. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:39 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1ca6b011-1f44-4b10-946b-8e8ad8fe6491 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062102 Nov 28 13:55:39 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:55:39 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:40 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:40 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-535040327", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "d123dddc-c4d6-4211-a9d5-6579178447f7"}], "security_groups": [{"name": "tempest-securitygroup--709133346"}], "key_name": "tempest-keypair-1885537121", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:40 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] validate_networks() for [('d123dddc-c4d6-4211-a9d5-6579178447f7', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:41 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:41 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:55:41 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 Nov 28 13:55:41 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1507271553", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220"}], "security_groups": [{"name": "tempest-securitygroup--1230589781"}], "key_name": "tempest-keypair-888199441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Getting quotas for project 0eb964406b0844ce997488844a2b0676. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Getting quotas for user c126fcfb0e4747ccaaf814d508698c55 and project 0eb964406b0844ce997488844a2b0676. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:42 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] validate_networks() for [('6ed64d27-5b2e-4ac9-be8f-4e65a223f220', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 2.440626 Nov 28 13:55:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 22/70] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 13:55:40 2023] POST /compute/v2.1/servers => generated 403 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 13:55:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-16b85339-e4f2-441d-ad5a-8df6cb67634b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-16b85339-e4f2-441d-ad5a-8df6cb67634b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:43 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-16b85339-e4f2-441d-ad5a-8df6cb67634b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:43 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-16b85339-e4f2-441d-ad5a-8df6cb67634b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:43 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-16b85339-e4f2-441d-ad5a-8df6cb67634b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-16b85339-e4f2-441d-ad5a-8df6cb67634b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 200 len: 1320 microversion: 2.49 time: 0.249138 Nov 28 13:55:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 26/71] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:55:42 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:55:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:55:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074362 Nov 28 13:55:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 23/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Getting quotas for project b65587be998440ed8f615dcb2f8f0d97. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Getting quotas for user ecf1fd2414db4fb9a5006cc8f5441745 and project b65587be998440ed8f615dcb2f8f0d97. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:44 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.695661 Nov 28 13:55:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:42 2023] POST /compute/v2.1/servers => generated 404 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:55:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c75877e1-8d20-4d74-a613-19ef576aca72 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c75877e1-8d20-4d74-a613-19ef576aca72 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:44 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-c75877e1-8d20-4d74-a613-19ef576aca72 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf1fd2414db4fb9a5006cc8f5441745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65587be998440ed8f615dcb2f8f0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c75877e1-8d20-4d74-a613-19ef576aca72 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2" status: 200 len: 1223 microversion: 2.1 time: 0.096658 Nov 28 13:55:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 27/74] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:44 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Creating event network-changed:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:55:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068463 Nov 28 13:55:47 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 24/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Creating event network-changed:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 13:55:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050034 Nov 28 13:55:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:50 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-374c40b7-5eec-4d19-a6ab-02ae40c4794f tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Action: 'create', calling method: .version_select at 0x7fedf13e72e0>, body: {"keypair": {"name": "tempest-keypair-1355928653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCI7gVF0ciHiIMVAJZbprWHL7zURwQNS0Z7LcSqMKBqZ4iid4/3E0j/cFAiCmqvQgRBJ7cRgNWmkMO5eTy2VY9d4WYAn8RfhPs9LVIcR+tbmQ11oSnDXM+sw9EFjRsdGw=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:50 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-374c40b7-5eec-4d19-a6ab-02ae40c4794f tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Getting quotas for project 31479b67e7b34434a9498cb6b982d4f7. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:50 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-374c40b7-5eec-4d19-a6ab-02ae40c4794f tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Getting quotas for user 39fa3c5315ca4202bd2fdde394f2ccba and project 31479b67e7b34434a9498cb6b982d4f7. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-374c40b7-5eec-4d19-a6ab-02ae40c4794f tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.248347 Nov 28 13:55:50 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 28/77] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:55:50 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-775124193", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c"}], "security_groups": [{"name": "tempest-securitygroup--1886593726"}], "key_name": "tempest-keypair-1355928653", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:52 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] validate_networks() for [('51f3b6a3-ef05-464a-a3df-dcd433b3e54c', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:55:53 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-plugged", "status": "completed", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:53 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Creating event network-vif-plugged:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:55:53 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040901 Nov 28 13:55:53 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Getting quotas for project 31479b67e7b34434a9498cb6b982d4f7. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Getting quotas for user 39fa3c5315ca4202bd2fdde394f2ccba and project 31479b67e7b34434a9498cb6b982d4f7. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:55:53 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:55:53 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.949536 Nov 28 13:55:53 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 25/79] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:55:52 2023] POST /compute/v2.1/servers => generated 404 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:55:53 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d2e89ab1-d767-4660-a898-3ab3d14fd90b tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:53 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d2e89ab1-d767-4660-a898-3ab3d14fd90b tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:53 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-d2e89ab1-d767-4660-a898-3ab3d14fd90b tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa3c5315ca4202bd2fdde394f2ccba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31479b67e7b34434a9498cb6b982d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d2e89ab1-d767-4660-a898-3ab3d14fd90b tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d" status: 200 len: 1237 microversion: 2.1 time: 0.071573 Nov 28 13:55:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 29/80] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:53 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:55 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:55 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:55:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-plugged", "status": "completed", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Creating event network-vif-plugged:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:55:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038593 Nov 28 13:55:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:57 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a3612-5042-420f-9911-ec641017d399", "name": "network-vif-plugged", "status": "completed", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Creating event network-vif-plugged:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 13:55:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154446 Nov 28 13:55:57 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 26/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Creating event network-changed:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:55:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053424 Nov 28 13:55:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:58 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5d849851-6992-4397-bbe3-d03e949c2fe9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1534 microversion: 2.1 time: 0.692459 Nov 28 13:55:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 27/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:58 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1534 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:59 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:55:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-22366969-de10-4037-b3ac-44029ff48300 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1492 microversion: 2.1 time: 0.880809 Nov 28 13:55:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 30/85] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:55:58 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1492 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:55:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a3612-5042-420f-9911-ec641017d399", "name": "network-vif-plugged", "status": "completed", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}, {"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-plugged", "status": "completed", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}, {"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-plugged", "status": "completed", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:55:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:55:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:55:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:55:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Creating event network-vif-plugged:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 13:55:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Creating event network-vif-plugged:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 13:55:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Creating event network-vif-plugged:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 13:55:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.064045 Nov 28 13:55:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:55:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:01 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "name": "network-vif-plugged", "status": "completed", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=101,nova_api:INSERT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Creating event network-vif-plugged:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:56:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503774 Nov 28 13:56:01 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:56:01 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e3a37647-59ed-4365-83e5-be731c474df6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1540 microversion: 2.1 time: 0.306641 Nov 28 13:56:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 31/88] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:01 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1540 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 13:56:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "name": "network-vif-plugged", "status": "completed", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Creating event network-vif-plugged:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:56:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040114 Nov 28 13:56:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:04 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:04 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:04 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "name": "network-vif-plugged", "status": "completed", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Creating event network-vif-plugged:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 13:56:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086187 Nov 28 13:56:04 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 29/90] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:05 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=14 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e52ba717-886e-47d2-ae22-04fe7a78b36f tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Action: 'create', calling method: .version_select at 0x7fedf0a60d30>, body: {"keypair": {"name": "tempest-keypair-1912575311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:05 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-e52ba717-886e-47d2-ae22-04fe7a78b36f tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting quotas for project c0ac13581ec1439eb3208cc3ddbec53a. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:05 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-e52ba717-886e-47d2-ae22-04fe7a78b36f tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting quotas for user 72ed3093372d454e9f271d3d672ce8a2 and project c0ac13581ec1439eb3208cc3ddbec53a. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e52ba717-886e-47d2-ae22-04fe7a78b36f tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.068599 Nov 28 13:56:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 32/91] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 13:56:05 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 13:56:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "name": "network-vif-plugged", "status": "completed", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Creating event network-vif-plugged:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 13:56:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073742 Nov 28 13:56:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:56:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-593415065", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4"}, {"port": "96485176-c454-4c24-bbe8-2cf688a69119", "tag": "port-1"}, {"port": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "tag": "port-2"}, {"uuid": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "tag": "net-1"}, {"uuid": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe"}, {"uuid": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "65c62840-e7a4-4bbb-861e-e4566ff910eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "dd24adeb-40e1-4836-a51a-a0948ce76397", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a1359c5c-4f59-4469-a1bf-3edbe189d324", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1056388006"}], "key_name": "tempest-keypair-1912575311", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:07 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:07 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] validate_networks() for [('bbcbef15-20ec-4dd4-adb4-47914fd7aba4', None, None, None, None, None), (None, None, '96485176-c454-4c24-bbe8-2cf688a69119', None, None, None), (None, None, '5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1', None, None, None), ('df5a3e5f-e2d5-416e-970f-b859d4c1f0fe', None, None, None, None, None), ('df5a3e5f-e2d5-416e-970f-b859d4c1f0fe', None, None, None, None, None), ('656c93c1-5ed5-4278-bdbc-08d25d0e60ab', '10.2.2.100', None, None, None, None), ('656c93c1-5ed5-4278-bdbc-08d25d0e60ab', '10.2.2.200', None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:56:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-942f48fb-1ff5-475e-b884-f1de0d5174d6 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Action: 'create', calling method: .version_select at 0x7fedf0a63d00>, body: {"keypair": {"name": "tempest-keypair-1794267935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:08 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-942f48fb-1ff5-475e-b884-f1de0d5174d6 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting quotas for project 112860fded124331bc667a597f4c695d. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:08 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-942f48fb-1ff5-475e-b884-f1de0d5174d6 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting quotas for user a16ed449c2e749fcafc01dd97b83241a and project 112860fded124331bc667a597f4c695d. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-942f48fb-1ff5-475e-b884-f1de0d5174d6 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.062334 Nov 28 13:56:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 33/93] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 13:56:08 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting quotas for project c0ac13581ec1439eb3208cc3ddbec53a. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting quotas for user 72ed3093372d454e9f271d3d672ce8a2 and project c0ac13581ec1439eb3208cc3ddbec53a. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-493600760", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "b7880457-5d82-42a8-a9eb-7bd4fe365367"}, {"port": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "tag": "port-1"}, {"port": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "tag": "port-2"}, {"uuid": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "tag": "net-1"}, {"uuid": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179"}, {"uuid": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "46ef3fc0-9e51-4dec-bb48-5113d0dde6ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c4143e1d-5911-4ff6-a035-e7c81788faa1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1428755739"}], "key_name": "tempest-keypair-1794267935", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:11 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:11 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-79209636-ac90-458c-adb6-08385d81313f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 200 len: 1543 microversion: 2.1 time: 0.532832 Nov 28 13:56:11 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:10 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 1543 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:56:11 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='65c62840-e7a4-4bbb-861e-e4566ff910eb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='dd24adeb-40e1-4836-a51a-a0948ce76397',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1359c5c-4f59-4469-a1bf-3edbe189d324',volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:56:11 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] validate_networks() for [('b7880457-5d82-42a8-a9eb-7bd4fe365367', None, None, None, None, None), (None, None, 'c91797e6-0bbb-48ea-b5c2-278b0b4319ef', None, None, None), (None, None, '605c90e8-31d1-4efa-b5c1-de9f7eeaec51', None, None, None), ('7e1f4582-88e4-4ecd-b385-35a0e8fa5179', None, None, None, None, None), ('7e1f4582-88e4-4ecd-b385-35a0e8fa5179', None, None, None, None, None), ('8e2471c7-dcf3-42c4-afce-c881d0ad2d8a', '10.2.2.100', None, None, None, None), ('8e2471c7-dcf3-42c4-afce-c881d0ad2d8a', '10.2.2.200', None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:56:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 4.258842 Nov 28 13:56:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 30/95] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 13:56:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 4261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 13:56:11 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-133b2575-389b-4550-92ad-1a6e0f4de9d6 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:11 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-133b2575-389b-4550-92ad-1a6e0f4de9d6 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:11 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=12 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:11 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-133b2575-389b-4550-92ad-1a6e0f4de9d6 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:12 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-133b2575-389b-4550-92ad-1a6e0f4de9d6 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:12 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-133b2575-389b-4550-92ad-1a6e0f4de9d6 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-133b2575-389b-4550-92ad-1a6e0f4de9d6 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 200 len: 1277 microversion: 2.32 time: 0.188234 Nov 28 13:56:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 33/96] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:56:11 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting quotas for project 112860fded124331bc667a597f4c695d. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:13 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting quotas for user a16ed449c2e749fcafc01dd97b83241a and project 112860fded124331bc667a597f4c695d. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:14 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:56:14 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='46ef3fc0-9e51-4dec-bb48-5113d0dde6ab',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4143e1d-5911-4ff6-a035-e7c81788faa1',volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:56:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.264878 Nov 28 13:56:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 34/97] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 13:56:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 3272 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 28 13:56:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f025a2d2-4920-4779-b10f-e5731663dbb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:14 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f025a2d2-4920-4779-b10f-e5731663dbb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:14 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-f025a2d2-4920-4779-b10f-e5731663dbb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:14 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-f025a2d2-4920-4779-b10f-e5731663dbb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:14 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-f025a2d2-4920-4779-b10f-e5731663dbb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f025a2d2-4920-4779-b10f-e5731663dbb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 200 len: 1277 microversion: 2.42 time: 0.099800 Nov 28 13:56:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 31/98] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:56:14 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:14 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7ef84da0-af55-4530-bcb5-92e5734c59ee tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6" status: 200 len: 1542 microversion: 2.1 time: 0.321226 Nov 28 13:56:15 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 34/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:14 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6 => generated 1542 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:56:19 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Creating event network-changed:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075551 Nov 28 13:56:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 35/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "96485176-c454-4c24-bbe8-2cf688a69119"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:21 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:21 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=30 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Creating event network-changed:96485176-c454-4c24-bbe8-2cf688a69119 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048491 Nov 28 13:56:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 32/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:56:23 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:23 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=41 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Creating event network-changed:5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037929 Nov 28 13:56:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=14 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "c34e615b-e133-4780-8a90-ca0fb5262dfe"}, {"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}, {"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b"}, {"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Creating event network-changed:c34e615b-e133-4780-8a90-ca0fb5262dfe for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Creating event network-changed:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Creating event network-changed:03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Creating event network-changed:c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.062536 Nov 28 13:56:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 36/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:25 2023] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:27 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "cf289519-83a0-4374-b2e5-757e5e7248f1"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Creating event network-changed:cf289519-83a0-4374-b2e5-757e5e7248f1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046542 Nov 28 13:56:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 33/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51"}, {"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "10cbc52f-989f-4a58-9fea-8ca5184c55d3"}, {"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "edf36fdd-4dd8-4465-8669-37b6adf82416"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Creating event network-changed:605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Creating event network-changed:10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Creating event network-changed:edf36fdd-4dd8-4465-8669-37b6adf82416 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.051482 Nov 28 13:56:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:31 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Creating event network-changed:9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065168 Nov 28 13:56:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 37/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:33 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9b5d8672-cda2-4ffd-a203-9502e98d00f0 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 200 len: 1625 microversion: 2.49 time: 0.530105 Nov 28 13:56:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 34/107] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:56:33 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 1625 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:56:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb"}, {"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "494d17d8-bf46-4767-852b-4e578ef43377"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Creating event network-changed:a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Creating event network-changed:494d17d8-bf46-4767-852b-4e578ef43377 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:56:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033150 Nov 28 13:56:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:34 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:34 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf1fd2414db4fb9a5006cc8f5441745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65587be998440ed8f615dcb2f8f0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0654e7d1-32de-492b-8013-905b49af6b6b tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2" status: 200 len: 1523 microversion: 2.1 time: 0.368521 Nov 28 13:56:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 38/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:34 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=10 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:44 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa3c5315ca4202bd2fdde394f2ccba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31479b67e7b34434a9498cb6b982d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-663c99d2-2b67-42be-91cb-2eeb729b0cbc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d" status: 200 len: 1552 microversion: 2.1 time: 0.226944 Nov 28 13:56:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 35/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:43 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:56:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=17 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=5 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Creating event network-vif-plugged:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065078 Nov 28 13:56:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=5 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=14 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:56:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Creating event network-vif-plugged:03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051039 Nov 28 13:56:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 39/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "96485176-c454-4c24-bbe8-2cf688a69119"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "96485176-c454-4c24-bbe8-2cf688a69119"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "c34e615b-e133-4780-8a90-ca0fb5262dfe"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "c34e615b-e133-4780-8a90-ca0fb5262dfe"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:96485176-c454-4c24-bbe8-2cf688a69119 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:96485176-c454-4c24-bbe8-2cf688a69119 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:c34e615b-e133-4780-8a90-ca0fb5262dfe for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Creating event network-vif-plugged:c34e615b-e133-4780-8a90-ca0fb5262dfe for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.042715 Nov 28 13:56:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 36/113] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 28 13:56:48 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:56:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "cf289519-83a0-4374-b2e5-757e5e7248f1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "cf289519-83a0-4374-b2e5-757e5e7248f1"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Creating event network-vif-plugged:03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Creating event network-vif-plugged:cf289519-83a0-4374-b2e5-757e5e7248f1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Creating event network-vif-plugged:cf289519-83a0-4374-b2e5-757e5e7248f1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043013 Nov 28 13:56:50 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:50 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "10cbc52f-989f-4a58-9fea-8ca5184c55d3"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "10cbc52f-989f-4a58-9fea-8ca5184c55d3"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Creating event network-vif-plugged:10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Creating event network-vif-plugged:10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:56:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049660 Nov 28 13:56:50 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 40/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a64989ef-6513-4f1b-8cb8-bc4c7b76e60a tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Action: 'create', calling method: .version_select at 0x7fedf0ae0310>, body: {"keypair": {"name": "tempest-keypair-1571158505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEZcduiQ4Bg+SyAMn1YHq4xZH858Iy0RGGFa+eLBzBoZOCJYpecnguM8KrxCXYdoPpgbGSlntpvAvtlnQy48NNkpQqMwqeZODnZhOhQ9HS/mZfIvCp+Xx38biZYtIPHOA=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:50 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-a64989ef-6513-4f1b-8cb8-bc4c7b76e60a tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:50 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-a64989ef-6513-4f1b-8cb8-bc4c7b76e60a tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for user 570ac6978fc249ba93d39e40d5d7eac7 and project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a64989ef-6513-4f1b-8cb8-bc4c7b76e60a tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098141 Nov 28 13:56:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 37/116] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:56:50 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1509611543", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877"}], "security_groups": [{"name": "tempest-securitygroup--987838993"}], "key_name": "tempest-keypair-1571158505", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:52 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] validate_networks() for [('2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for user 570ac6978fc249ba93d39e40d5d7eac7 and project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:56:53 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:56:53 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.637383 Nov 28 13:56:53 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 40/117] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:56:52 2023] POST /compute/v2.1/servers => generated 403 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:56:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3ff117e4-5430-475b-a617-a174978b2f79 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:53 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3ff117e4-5430-475b-a617-a174978b2f79 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:53 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-3ff117e4-5430-475b-a617-a174978b2f79 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3ff117e4-5430-475b-a617-a174978b2f79 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f" status: 200 len: 1235 microversion: 2.1 time: 0.074036 Nov 28 13:56:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 41/118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:53 2023] GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f => generated 1235 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:56:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Creating event network-changed:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:56:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057534 Nov 28 13:56:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 38/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "name": "network-vif-plugged", "status": "completed", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Creating event network-vif-plugged:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:56:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054298 Nov 28 13:56:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1115132190", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "73322956-2161-4c75-88f6-ddf480017fbe"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] validate_networks() for [('73322956-2161-4c75-88f6-ddf480017fbe', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:56:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-92f298b1-6ffa-4397-bdc7-fcbdde90c704 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.364987 Nov 28 13:56:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:56:59 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-interface => generated 282 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Getting quotas for project 0f9642956daa4507a3b6791bcd41d9d3. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Getting quotas for user 237e50c8ccfa49169a1bdca99f46e616 and project 0f9642956daa4507a3b6791bcd41d9d3. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:56:59 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:56:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.655677 Nov 28 13:56:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 39/122] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:56:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:56:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e5dfb853-fbbc-44d7-b983-04b788c4cc0d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:56:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-e5dfb853-fbbc-44d7-b983-04b788c4cc0d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:56:59 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-e5dfb853-fbbc-44d7-b983-04b788c4cc0d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:56:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e5dfb853-fbbc-44d7-b983-04b788c4cc0d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 200 len: 1209 microversion: 2.1 time: 0.086102 Nov 28 13:56:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:56:59 2023] GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "name": "network-vif-plugged", "status": "completed", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Creating event network-vif-plugged:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:57:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Nov 28 13:57:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 43/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fcfe3a12-ccd4-4812-b748-e5fe774ce96d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/ips" status: 200 len: 103 microversion: 2.1 time: 0.082808 Nov 28 13:57:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 40/125] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 13:57:00 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/ips => generated 103 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Creating event network-vif-plugged:605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050203 Nov 28 13:57:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Creating event network-changed:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Creating event network-vif-plugged:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Creating event network-vif-plugged:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Creating event network-vif-plugged:c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4d4a7900-1a88-44a0-a57d-9d3b5f8b46ae tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.485439 Nov 28 13:57:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:57:02 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/os-interface => generated 282 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.073944 Nov 28 13:57:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:03 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-66589c20-84f9-4338-a28b-78cf2536c20d tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1540 microversion: 2.1 time: 0.214391 Nov 28 13:57:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 44/129] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:04 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1540 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "edf36fdd-4dd8-4465-8669-37b6adf82416"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "edf36fdd-4dd8-4465-8669-37b6adf82416"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Creating event network-vif-plugged:605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Creating event network-vif-plugged:edf36fdd-4dd8-4465-8669-37b6adf82416 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Creating event network-vif-plugged:edf36fdd-4dd8-4465-8669-37b6adf82416 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.075263 Nov 28 13:57:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f"}, {"name": "network-changed", "server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "494d17d8-bf46-4767-852b-4e578ef43377"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "494d17d8-bf46-4767-852b-4e578ef43377"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Creating event network-vif-plugged:c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Creating event network-vif-plugged:9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Creating event network-changed:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Creating event network-vif-plugged:9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Creating event network-vif-plugged:494d17d8-bf46-4767-852b-4e578ef43377 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Creating event network-vif-plugged:494d17d8-bf46-4767-852b-4e578ef43377 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1034 microversion: 2.1 time: 0.053192 Nov 28 13:57:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 46/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 1034 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-2c0dd5fc-dc7e-4192-be51-a56cac562da2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 200 len: 2818 microversion: 2.32 time: 2.747939 Nov 28 13:57:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 44/132] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:57:02 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 2818 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Creating event network-vif-plugged:a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070832 Nov 28 13:57:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6dd3f41-6624-4976-8316-6d52ce2c4373"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:05 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1227b9a1-7be2-4a86-8c76-174153fdb7d3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1540 microversion: 2.1 time: 0.837966 Nov 28 13:57:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 43/134] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:04 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1540 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599037 Nov 28 13:57:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 46/135] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:57:05 2023] POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:05 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:05 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:05 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-79335036-0413-429f-bdbd-b49faed89773 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 200 len: 1871 microversion: 2.42 time: 1.088452 Nov 28 13:57:05 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 47/136] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:57:04 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 1871 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 13:57:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb"}, {"name": "network-changed", "server_uuid": "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b", "tag": "9729fc6f-4406-4ec7-9f32-1938bd85d524"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Creating event network-vif-plugged:a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:57:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Creating event network-changed:9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b on user Nov 28 13:57:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042322 Nov 28 13:57:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b", "name": "network-vif-plugged", "status": "completed", "tag": "9729fc6f-4406-4ec7-9f32-1938bd85d524"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Creating event network-vif-plugged:9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b on user Nov 28 13:57:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061674 Nov 28 13:57:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:11 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b", "name": "network-vif-plugged", "status": "completed", "tag": "9729fc6f-4406-4ec7-9f32-1938bd85d524"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:11 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:11 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:11 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:11 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:11 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Creating event network-vif-plugged:9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b on user Nov 28 13:57:11 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048127 Nov 28 13:57:11 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 48/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=10 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fba1c40d-f6a4-407f-b8f1-444b298f009d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.216642 Nov 28 13:57:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 45/140] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:57:11 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-interface => generated 282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:12 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949a3612-5042-420f-9911-ec641017d399", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Creating event network-changed:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 13:57:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061222 Nov 28 13:57:12 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 48/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-bf678061-cce6-44d5-b6f5-a6ee23997c51 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/ips" status: 200 len: 108 microversion: 2.1 time: 0.065019 Nov 28 13:57:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 13:57:12 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/ips => generated 108 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:15 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fb24c2ad-6411-48ab-9d5a-79f4d6e4776f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.186532 Nov 28 13:57:15 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 46/143] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:57:15 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-interface => generated 282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Creating event network-changed:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 13:57:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049393 Nov 28 13:57:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 50/144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:57:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.592466 Nov 28 13:57:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 49/145] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:57:15 2023] POST /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd388849-316c-483a-a70e-77373ca06f10"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357736 Nov 28 13:57:19 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 47/146] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:57:19 2023] POST /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:20 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Going to try to stop instance {{(pid=65027) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 13:57:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action" status: 202 len: 0 microversion: 2.1 time: 0.134326 Nov 28 13:57:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 51/147] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 13:57:20 2023] POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:20 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-6367c1b5-bc97-4d5e-a170-4f0c2090b543 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1709 microversion: 2.1 time: 0.239396 Nov 28 13:57:20 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 50/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:20 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1709 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-unplugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Creating event network-vif-unplugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:57:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071148 Nov 28 13:57:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 48/149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:57:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029965 Nov 28 13:57:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 52/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7ba1e7ea-4e53-4379-b295-9bd2673abc1c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: .version_select at 0x7fedf090f490>, body: {"keypair": {"name": "tempest-keypair-1167956881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZKtitTlaexaynsP4WYOVlVy18YpeWUi10uTrsxp5Ap02gRbOPB7ajo7zQlg7nEQY/n9BSdbr0uf/IC3pIF4N0iY3+Q3kTObIRV7J9kIk52u+nAsjapNr4dUfTwF11g5A=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:27 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-7ba1e7ea-4e53-4379-b295-9bd2673abc1c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:57:27 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-7ba1e7ea-4e53-4379-b295-9bd2673abc1c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:57:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7ba1e7ea-4e53-4379-b295-9bd2673abc1c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059473 Nov 28 13:57:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 51/151] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 13:57:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-303146235", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7"}], "security_groups": [{"name": "tempest-securitygroup--1896069543"}], "key_name": "tempest-keypair-1167956881", "user_data": "}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] validate_networks() for [('eb697d01-87f7-4768-84bb-0e25fdf0c3e7', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:57:29 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:57:30 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:57:30 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:57:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.573640 Nov 28 13:57:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 49/152] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:57:29 2023] POST /compute/v2.1/servers => generated 400 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 13:57:30 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d38a76bc-1f18-429e-b447-d5485c8ccf0e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:30 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d38a76bc-1f18-429e-b447-d5485c8ccf0e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:30 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-d38a76bc-1f18-429e-b447-d5485c8ccf0e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d38a76bc-1f18-429e-b447-d5485c8ccf0e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 200 len: 1233 microversion: 2.1 time: 0.128853 Nov 28 13:57:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 53/153] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:30 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 1233 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7e0b1213-a60e-43ee-a7eb-c2e70d3b4ba0"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] HTTP exception thrown: Volume 7e0b1213-a60e-43ee-a7eb-c2e70d3b4ba0 could not be found. Nov 28 13:57:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Returning 400 to user: Volume 7e0b1213-a60e-43ee-a7eb-c2e70d3b4ba0 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:57:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-75fcb09c-4384-468c-8662-a37a7b44abff tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments/fd388849-316c-483a-a70e-77373ca06f10" status: 400 len: 107 microversion: 2.1 time: 0.555362 Nov 28 13:57:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 52/154] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 13:57:32 2023] PUT /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments/fd388849-316c-483a-a70e-77373ca06f10 => generated 107 bytes in 557 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'services' on Instance uuid 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 13:57:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments/fd388849-316c-483a-a70e-77373ca06f10" status: 202 len: 0 microversion: 2.1 time: 0.394088 Nov 28 13:57:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 50/155] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 13:57:32 2023] DELETE /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments/fd388849-316c-483a-a70e-77373ca06f10 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e61d852c-5627-466e-9533-60f436dfc75f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073235 Nov 28 13:57:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 54/156] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 13:57:33 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Creating event network-changed:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:57:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033127 Nov 28 13:57:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-386dee58-bc40-49b5-98bb-000cac8d334e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.230747 Nov 28 13:57:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 51/158] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 13:57:33 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-interface => generated 282 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:35 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Creating event network-changed:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:57:35 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 Nov 28 13:57:35 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 54/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9af020ab-299a-41cf-ac48-3151e63b67d0 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.199886 Nov 28 13:57:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 55/160] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:57:34 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-interface => generated 282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:35 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-38f4d5cf-4541-4180-8e4a-cb25a52503d3 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 200 len: 1625 microversion: 2.49 time: 0.250350 Nov 28 13:57:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 52/161] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:57:35 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 1625 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "tag": "nic-tag"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2590ffd1-7637-4a90-ad5d-4209148c61a7"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:36 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "name": "network-vif-plugged", "status": "completed", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Creating event network-vif-plugged:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:57:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037179 Nov 28 13:57:36 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 53/162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:36 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "POST /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546755 Nov 28 13:57:36 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 56/163] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:57:36 2023] POST /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Creating event network-changed:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 13:57:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040939 Nov 28 13:57:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "name": "network-vif-plugged", "status": "completed", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}, {"name": "network-changed", "server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "tag": "90a8cdca-86d8-40cc-990f-6a68ae35bd69"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Creating event network-vif-plugged:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:57:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Creating event network-changed:90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:57:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066895 Nov 28 13:57:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 57/165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:38 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:39 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-plugged", "status": "completed", "tag": "90a8cdca-86d8-40cc-990f-6a68ae35bd69"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Creating event network-vif-plugged:90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:57:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075328 Nov 28 13:57:39 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-interface" status: 200 len: 282 microversion: 2.49 time: 4.056842 Nov 28 13:57:39 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 55/167] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Nov 28 13:57:35 2023] POST /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-interface => generated 282 bytes in 4059 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ee43782-0ea5-4236-bcb9-ea574a51fd6f", "tag": "volume-tag"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.425280 Nov 28 13:57:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 58/168] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 13:57:39 2023] POST /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:57:41 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:41 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:41 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-plugged", "status": "completed", "tag": "90a8cdca-86d8-40cc-990f-6a68ae35bd69"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:41 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Creating event network-vif-plugged:90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:57:41 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052445 Nov 28 13:57:41 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:43 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-075a09bb-bd9f-410c-b6a2-6a4060f623c2 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f" status: 200 len: 1543 microversion: 2.1 time: 0.241041 Nov 28 13:57:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:43 2023] GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f => generated 1543 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3c1b09f9-bd43-4a8e-b59a-116e12a518f4 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.158631 Nov 28 13:57:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 59/171] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:57:44 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-interface => generated 283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:45 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:45 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:45 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Creating event network-changed:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:57:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064586 Nov 28 13:57:45 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 57/172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:57:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c256684c-2c3b-4052-8a85-942271fc83a0"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449332 Nov 28 13:57:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 57/173] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:57:45 2023] POST /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:50 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a39cd23b-5861-43a3-b9a5-2f895bf17323 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 200 len: 1492 microversion: 2.1 time: 0.245129 Nov 28 13:57:50 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 60/174] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:50 2023] GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 1492 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:51 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'services' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 13:57:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-volume_attachments/6ee43782-0ea5-4236-bcb9-ea574a51fd6f" status: 202 len: 0 microversion: 2.49 time: 0.234894 Nov 28 13:57:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 58/175] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 13:57:51 2023] DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-volume_attachments/6ee43782-0ea5-4236-bcb9-ea574a51fd6f => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-18d68219-f557-43e5-8fb7-950e3ffb6892 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1657 microversion: 2.1 time: 0.219181 Nov 28 13:57:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:55 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1657 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:55 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4e63470b-de70-42dd-91a2-d6409ad294c6 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1657 microversion: 2.1 time: 0.214863 Nov 28 13:57:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 61/177] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:57:55 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1657 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:57:56 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:56 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:56 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:57:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e27a3e6d-31ea-4c27-9051-c2efcd608cb0 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 200 len: 2823 microversion: 2.42 time: 0.513170 Nov 28 13:57:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 59/178] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:57:55 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 2823 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f4e3b65a-e2e0-4261-8f67-f4b561ad120c"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:58 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments/2590ffd1-7637-4a90-ad5d-4209148c61a7" status: 202 len: 0 microversion: 2.1 time: 0.450573 Nov 28 13:57:58 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 13:57:57 2023] PUT /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments/2590ffd1-7637-4a90-ad5d-4209148c61a7 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c256684c-2c3b-4052-8a85-942271fc83a0", "create_info": {"snapshot_id": "df4520e7-d77e-4cfd-952e-b7f33f568c89", "type": "qcow2", "new_file": "new_file"}}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4cfc4cc-712b-461a-95da-c44375c58fac(cell1) {{(pid=65027) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.204905 Nov 28 13:57:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 62/180] 10.0.0.210 () {64 vars in 1287 bytes} [Tue Nov 28 13:57:58 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4cfc4cc-712b-461a-95da-c44375c58fac(cell1) {{(pid=65025) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%22c256684c-2c3b-4052-8a85-942271fc83a0%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.070249 Nov 28 13:57:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 60/181] 10.0.0.210 () {62 vars in 1442 bytes} [Tue Nov 28 13:57:58 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%22c256684c-2c3b-4052-8a85-942271fc83a0%22%7D => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:59 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lazy-loading 'services' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 13:57:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments/c256684c-2c3b-4052-8a85-942271fc83a0" status: 202 len: 0 microversion: 2.1 time: 0.232522 Nov 28 13:57:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 13:57:59 2023] DELETE /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments/c256684c-2c3b-4052-8a85-942271fc83a0 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:57:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:57:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b90a9d84-ab91-4a19-af56-82b41850e72a tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074792 Nov 28 13:57:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 63/183] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 13:57:59 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0d1f5763-bbda-4e52-8cb9-f6d3a3daa262 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2/os-interface" status: 200 len: 1826 microversion: 2.32 time: 0.324921 Nov 28 13:58:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 61/184] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 13:58:04 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2/os-interface => generated 1826 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Creating event network-changed:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037912 Nov 28 13:58:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:07 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:07 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:07 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3697fb7b-ce5e-45c9-8821-9e61be52d9d2 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 200 len: 2818 microversion: 2.32 time: 0.459244 Nov 28 13:58:07 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 64/186] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:58:06 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 2818 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-650ab44b-30f6-471e-adfd-5aea9dc2a1ad tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2/os-interface" status: 200 len: 1826 microversion: 2.32 time: 0.136031 Nov 28 13:58:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 62/187] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 13:58:07 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2/os-interface => generated 1826 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:58:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 204 len: 0 microversion: 2.32 time: 0.295688 Nov 28 13:58:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 13:58:08 2023] DELETE /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:09 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-77fc5c7d-e646-4310-a6f1-231cfc87df63 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 200 len: 2943 microversion: 2.32 time: 0.362072 Nov 28 13:58:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 65/189] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:58:09 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 2943 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:09 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Creating event network-vif-unplugged:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047417 Nov 28 13:58:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 63/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:10 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Creating event network-vif-unplugged:03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031587 Nov 28 13:58:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:11 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:11 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ace47415-075e-463c-8aa5-e56a17dfd678 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1686 microversion: 2.1 time: 0.547423 Nov 28 13:58:11 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 66/192] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:58:10 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1686 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "96485176-c454-4c24-bbe8-2cf688a69119"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "96485176-c454-4c24-bbe8-2cf688a69119"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "c34e615b-e133-4780-8a90-ca0fb5262dfe"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "c34e615b-e133-4780-8a90-ca0fb5262dfe"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-plugged:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-unplugged:96485176-c454-4c24-bbe8-2cf688a69119 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-plugged:96485176-c454-4c24-bbe8-2cf688a69119 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-unplugged:5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-plugged:5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-unplugged:c34e615b-e133-4780-8a90-ca0fb5262dfe for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Creating event network-vif-plugged:c34e615b-e133-4780-8a90-ca0fb5262dfe for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.053622 Nov 28 13:58:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 64/193] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 28 13:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:12 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "cf289519-83a0-4374-b2e5-757e5e7248f1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "cf289519-83a0-4374-b2e5-757e5e7248f1"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Creating event network-vif-plugged:03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Creating event network-vif-unplugged:cf289519-83a0-4374-b2e5-757e5e7248f1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Creating event network-vif-plugged:cf289519-83a0-4374-b2e5-757e5e7248f1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:12 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.049206 Nov 28 13:58:12 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 64/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:13 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-unplugged", "status": "completed", "tag": "10cbc52f-989f-4a58-9fea-8ca5184c55d3"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-plugged", "status": "completed", "tag": "10cbc52f-989f-4a58-9fea-8ca5184c55d3"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:13 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Creating event network-vif-unplugged:10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:13 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Creating event network-vif-plugged:10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:13 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033718 Nov 28 13:58:13 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 67/195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-interface/90a8cdca-86d8-40cc-990f-6a68ae35bd69" status: 202 len: 0 microversion: 2.49 time: 0.046235 Nov 28 13:58:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 65/196] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Nov 28 13:58:14 2023] DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-interface/90a8cdca-86d8-40cc-990f-6a68ae35bd69 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e3b7c0f3-4693-45be-bb49-ba547cf78e56 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-instance-actions/req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b" status: 200 len: 474 microversion: 2.49 time: 0.217031 Nov 28 13:58:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 65/197] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 13:58:14 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-instance-actions/req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b => generated 474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:58:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-unplugged", "status": "completed", "tag": "90a8cdca-86d8-40cc-990f-6a68ae35bd69"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Creating event network-vif-unplugged:90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:58:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056288 Nov 28 13:58:15 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 68/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-deleted", "tag": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] Creating event network-vif-deleted:03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036097 Nov 28 13:58:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 66/199] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-13ac44df-3dce-4d4d-97e2-b4ab60831c23 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052756 Nov 28 13:58:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 13:58:16 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4969823a-640f-417f-955a-0960c5784f44 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055037 Nov 28 13:58:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 69/201] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 13:58:16 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2590ffd1-7637-4a90-ad5d-4209148c61a7"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments/f4e3b65a-e2e0-4261-8f67-f4b561ad120c" status: 202 len: 0 microversion: 2.1 time: 0.486757 Nov 28 13:58:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 67/202] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 13:58:16 2023] PUT /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments/f4e3b65a-e2e0-4261-8f67-f4b561ad120c => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:58:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-plugged", "status": "completed", "tag": "90a8cdca-86d8-40cc-990f-6a68ae35bd69"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Creating event network-vif-plugged:90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:58:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Nov 28 13:58:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 67/203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-deleted", "tag": "cf289519-83a0-4374-b2e5-757e5e7248f1"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-deleted", "tag": "c34e615b-e133-4780-8a90-ca0fb5262dfe"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-deleted", "tag": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8"}, {"server_uuid": "31d8d6df-6235-4a05-a03b-b6d67c3698b2", "name": "network-vif-deleted", "tag": "10cbc52f-989f-4a58-9fea-8ca5184c55d3"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Creating event network-vif-deleted:cf289519-83a0-4374-b2e5-757e5e7248f1 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Creating event network-vif-deleted:c34e615b-e133-4780-8a90-ca0fb5262dfe for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Creating event network-vif-deleted:2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] Creating event network-vif-deleted:10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 on user Nov 28 13:58:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032887 Nov 28 13:58:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 70/204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:20 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-611096e9-32b8-40ac-a551-e84252cf41ee tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 200 len: 1543 microversion: 2.1 time: 0.220881 Nov 28 13:58:20 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 68/205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:58:20 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 1543 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1f62c40d-055a-4ea6-9e9d-d61d791d987b tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044249 Nov 28 13:58:23 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 13:58:23 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 13:58:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1594648075", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "efa0e0e2-5675-40e1-9d88-b46b666489be"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:23 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] validate_networks() for [('efa0e0e2-5675-40e1-9d88-b46b666489be', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting quotas for project 75b572682eb94af0b628ee30a16d9225. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting quotas for user c9f9b1cc04a4417ebf987aa99a18e6a7 and project 75b572682eb94af0b628ee30a16d9225. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 13:58:24 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 13:58:24 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.686715 Nov 28 13:58:24 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 71/207] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 13:58:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 13:58:24 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4c7482cf-be7e-4fd1-82bd-e95d17f9b0f7 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:24 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-4c7482cf-be7e-4fd1-82bd-e95d17f9b0f7 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-4c7482cf-be7e-4fd1-82bd-e95d17f9b0f7 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:24 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4c7482cf-be7e-4fd1-82bd-e95d17f9b0f7 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2" status: 200 len: 1210 microversion: 2.1 time: 0.070467 Nov 28 13:58:24 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 69/208] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:58:24 2023] GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2 => generated 1210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51b39c5-001f-4f76-93c0-145fd3373cc2", "tag": "70e39897-4a33-4d71-a525-84ce5c721830"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Creating event network-changed:70e39897-4a33-4d71-a525-84ce5c721830 for instance a51b39c5-001f-4f76-93c0-145fd3373cc2 on user Nov 28 13:58:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030482 Nov 28 13:58:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51b39c5-001f-4f76-93c0-145fd3373cc2", "name": "network-vif-plugged", "status": "completed", "tag": "70e39897-4a33-4d71-a525-84ce5c721830"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Creating event network-vif-plugged:70e39897-4a33-4d71-a525-84ce5c721830 for instance a51b39c5-001f-4f76-93c0-145fd3373cc2 on user Nov 28 13:58:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042474 Nov 28 13:58:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 72/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:31 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51b39c5-001f-4f76-93c0-145fd3373cc2", "name": "network-vif-plugged", "status": "completed", "tag": "70e39897-4a33-4d71-a525-84ce5c721830"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:31 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=104,nova_cell1:INSERT=6,nova_cell1:UPDATE=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Creating event network-vif-plugged:70e39897-4a33-4d71-a525-84ce5c721830 for instance a51b39c5-001f-4f76-93c0-145fd3373cc2 on user Nov 28 13:58:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050200 Nov 28 13:58:31 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 70/211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-deleted", "tag": "90a8cdca-86d8-40cc-990f-6a68ae35bd69"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Creating event network-vif-deleted:90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:58:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Nov 28 13:58:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-12433dd9-af89-44c8-baf6-f1994aa89755 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.156455 Nov 28 13:58:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 73/213] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:58:43 2023] GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f/os-interface => generated 283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Creating event network-changed:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:58:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045847 Nov 28 13:58:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56478f59-9340-4f10-83f7-bbeee4419867", "device": "/dev/vdb"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302922 Nov 28 13:58:45 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 71/215] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:58:44 2023] POST /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ec50e50f-6f7b-4c46-8fe3-b1ce142bb6cd tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047673 Nov 28 13:58:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 13:58:49 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:50 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:58:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 204 len: 0 microversion: 2.1 time: 0.124548 Nov 28 13:58:50 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 13:58:50 2023] DELETE /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=30 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:50 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b", "name": "network-vif-unplugged", "status": "completed", "tag": "9729fc6f-4406-4ec7-9f32-1938bd85d524"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:50 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2d2ed173-e9d2-4df5-8d61-19858c6abd77 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 200 len: 1498 microversion: 2.1 time: 0.379948 Nov 28 13:58:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:58:50 2023] GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 1498 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Creating event network-vif-unplugged:9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b on user Nov 28 13:58:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067695 Nov 28 13:58:50 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 75/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b", "name": "network-vif-plugged", "status": "completed", "tag": "9729fc6f-4406-4ec7-9f32-1938bd85d524"}, {"server_uuid": "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b", "name": "network-vif-deleted", "tag": "9729fc6f-4406-4ec7-9f32-1938bd85d524"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Creating event network-vif-plugged:9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b on user Nov 28 13:58:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Creating event network-vif-deleted:9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b on user Nov 28 13:58:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041399 Nov 28 13:58:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 73/220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:58:54 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:58:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d" status: 204 len: 0 microversion: 2.1 time: 0.190068 Nov 28 13:58:54 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 73/221] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 13:58:54 2023] DELETE /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:54 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa3c5315ca4202bd2fdde394f2ccba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31479b67e7b34434a9498cb6b982d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-10d72677-c9e9-4b08-ba8f-5e8bf35f56fc tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d" status: 200 len: 1676 microversion: 2.1 time: 0.327382 Nov 28 13:58:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 76/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:58:54 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d => generated 1676 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "name": "network-vif-unplugged", "status": "completed", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Creating event network-vif-unplugged:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:58:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035006 Nov 28 13:58:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 74/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:56 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "name": "network-vif-deleted", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] Creating event network-vif-deleted:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:58:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035171 Nov 28 13:58:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 74/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dc143b-7f7a-46e4-85c2-bed1c455b92d", "name": "network-vif-plugged", "status": "completed", "tag": "0b01647b-3ee6-4152-adac-c584772d441a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Creating event network-vif-plugged:0b01647b-3ee6-4152-adac-c584772d441a for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d on user Nov 28 13:58:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057139 Nov 28 13:58:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 75/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:56 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-544867c1-936b-4bcf-8a12-d6d6fbcc98a1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.422768 Nov 28 13:58:56 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 77/226] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 13:58:56 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370/os-interface => generated 1830 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e25e4150-f9b7-4467-9735-4add32b8cb7c tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 200 len: 2823 microversion: 2.42 time: 0.712761 Nov 28 13:58:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 75/227] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:58:57 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 2823 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:58 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1bcc148d-3e5c-41b5-807a-5d2abcd05cf3 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1657 microversion: 2.1 time: 0.261908 Nov 28 13:58:58 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:58:58 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1657 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Creating event network-changed:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:58:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030231 Nov 28 13:58:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 76/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95820667-5de5-45e2-a99e-67643abf1bb1"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-154746df-67e6-4e7b-b8e0-42dc15fafeb1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.167718 Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 78/230] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 13:58:58 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370/os-interface => generated 1830 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:58:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460464 Nov 28 13:58:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 77/231] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:58:58 2023] POST /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:58:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] HTTP exception thrown: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. Nov 28 13:58:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Returning 404 to user: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:58:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8ff3a62c-56cc-41e7-84d6-b5af7cf2ce29 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 404 len: 111 microversion: 2.32 time: 0.034389 Nov 28 13:58:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 77/232] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:58:59 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:58:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-775eb6fc-b69b-4b8c-898b-154e18182c2a tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '.version_select at 0x7fedf0896710>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:58:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-775eb6fc-b69b-4b8c-898b-154e18182c2a tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912575311" status: 204 len: 0 microversion: 2.32 time: 0.146233 Nov 28 13:58:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 79/233] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 13:58:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912575311 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:59:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 204 len: 0 microversion: 2.42 time: 0.142198 Nov 28 13:59:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 78/234] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 13:59:01 2023] DELETE /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:01 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-dd233f39-d5ab-4d81-8642-5672198be6fa tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 200 len: 2948 microversion: 2.42 time: 0.577816 Nov 28 13:59:01 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 78/235] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:01 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 2948 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 13:59:01 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Creating event network-vif-unplugged:605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072112 Nov 28 13:59:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 80/236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Creating event network-vif-unplugged:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055817 Nov 28 13:59:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 79/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Creating event network-vif-unplugged:a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045061 Nov 28 13:59:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 79/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "edf36fdd-4dd8-4465-8669-37b6adf82416"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "edf36fdd-4dd8-4465-8669-37b6adf82416"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Creating event network-vif-plugged:605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Creating event network-vif-unplugged:edf36fdd-4dd8-4465-8669-37b6adf82416 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Creating event network-vif-plugged:edf36fdd-4dd8-4465-8669-37b6adf82416 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.044915 Nov 28 13:59:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 81/239] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:03 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:03 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-unplugged", "status": "completed", "tag": "494d17d8-bf46-4767-852b-4e578ef43377"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "494d17d8-bf46-4767-852b-4e578ef43377"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-plugged:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-unplugged:c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-plugged:c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-unplugged:9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-plugged:9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-unplugged:494d17d8-bf46-4767-852b-4e578ef43377 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Creating event network-vif-plugged:494d17d8-bf46-4767-852b-4e578ef43377 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.061474 Nov 28 13:59:03 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 80/240] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 28 13:59:03 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 13:59:04 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-plugged", "status": "completed", "tag": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Creating event network-vif-plugged:a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034247 Nov 28 13:59:04 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 80/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b02ee6d8-092f-4497-9245-defac00286f8 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-instance-actions/req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b" status: 200 len: 503 microversion: 2.49 time: 0.177028 Nov 28 13:59:05 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 82/242] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 13:59:04 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-instance-actions/req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b => generated 503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8238035e-902c-4e80-9506-1244053db1c5 tempest-TaggedAttachmentsTest-195862283 tempest-TaggedAttachmentsTest-195862283-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-instance-actions/req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b" status: 200 len: 503 microversion: 2.49 time: 0.055727 Nov 28 13:59:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 81/243] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 13:59:05 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-instance-actions/req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b => generated 503 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] HTTP exception thrown: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Returning 404 to user: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e41fb1b5-9e62-4e4e-bb0c-68e8a0c85496 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 404 len: 111 microversion: 2.32 time: 0.036237 Nov 28 13:59:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 81/244] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 13:59:05 2023] DELETE /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] HTTP exception thrown: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Returning 404 to user: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d1c75971-6cef-463c-9bdd-79ebec0488f3 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2" status: 404 len: 111 microversion: 2.32 time: 0.038008 Nov 28 13:59:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 82/245] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:05 2023] GET /compute/v2.1/servers/31d8d6df-6235-4a05-a03b-b6d67c3698b2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ef3b8365-ccf7-4d49-9b1a-bad85fad7410 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.066895 Nov 28 13:59:05 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 83/246] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 13:59:05 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:59:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 204 len: 0 microversion: 2.49 time: 0.132406 Nov 28 13:59:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 82/247] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 13:59:05 2023] DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:05 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5ef70f91-f056-4e37-a7b2-7d6413bdb45d tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 200 len: 1748 microversion: 2.49 time: 0.256485 Nov 28 13:59:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 83/248] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:05 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 1748 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 13:59:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-unplugged", "status": "completed", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Creating event network-vif-unplugged:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:59:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045629 Nov 28 13:59:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 84/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-deleted", "tag": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] Creating event network-vif-deleted:a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057475 Nov 28 13:59:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 83/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-plugged", "status": "completed", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}, {"server_uuid": "a9a21b61-5815-47ed-adac-040b1fc8e33a", "name": "network-vif-deleted", "tag": "885d9ccd-4b72-4063-b89a-ae6a3466a743"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Creating event network-vif-plugged:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:59:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Creating event network-vif-deleted:885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a on user Nov 28 13:59:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044117 Nov 28 13:59:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 84/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-deleted", "tag": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-deleted", "tag": "540a415e-6e64-4d9f-ba49-ec2a1a85439a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] Creating event network-vif-deleted:9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] Creating event network-vif-deleted:540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050880 Nov 28 13:59:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:11 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Going to try to start instance {{(pid=65025) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 13:59:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action" status: 202 len: 0 microversion: 2.1 time: 0.111614 Nov 28 13:59:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 84/253] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 13:59:11 2023] POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:11 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-519330e6-a750-44fe-985a-e63d25c9db2c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1695 microversion: 2.1 time: 0.311245 Nov 28 13:59:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 85/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:11 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1695 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:59:12 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-deleted", "tag": "494d17d8-bf46-4767-852b-4e578ef43377"}, {"server_uuid": "794937d9-3c23-41cf-bb74-767e93bc1370", "name": "network-vif-deleted", "tag": "edf36fdd-4dd8-4465-8669-37b6adf82416"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] Creating event network-vif-deleted:494d17d8-bf46-4767-852b-4e578ef43377 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] Creating event network-vif-deleted:edf36fdd-4dd8-4465-8669-37b6adf82416 for instance 794937d9-3c23-41cf-bb74-767e93bc1370 on user Nov 28 13:59:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051373 Nov 28 13:59:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Old instance type m1.tiny, new instance type m1.small {{(pid=65025) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting quotas for project d326de84f8224cef95e650bd92e7198f. Resources: {'cores', 'ram'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting quotas for user 14da9954e4fc44deb3c603165b10cf66 and project d326de84f8224cef95e650bd92e7198f. Resources: {'cores', 'ram'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 13:59:12 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 13:59:12 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/action" status: 202 len: 0 microversion: 2.1 time: 0.333398 Nov 28 13:59:12 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 85/256] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 13:59:12 2023] POST /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:12 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:13 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f58987f8-d38e-4f91-9edb-8a8498878bc4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1712 microversion: 2.1 time: 0.665280 Nov 28 13:59:13 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:12 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1712 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:14 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d22d1e0e-7fbd-4c95-bca1-683c1c95e6a5 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2" status: 200 len: 1494 microversion: 2.1 time: 0.252804 Nov 28 13:59:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:14 2023] GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2 => generated 1494 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:59:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-unplugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Creating event network-vif-unplugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:59:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65025) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 13:59:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051383 Nov 28 13:59:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 86/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:59:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}, {"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}, {"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:59:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:59:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 13:59:18 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65026) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 13:59:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056629 Nov 28 13:59:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 87/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:18 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-acf62d13-9dd4-444e-ac74-6adf8b46fca5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.255337 Nov 28 13:59:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 13:59:20 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0/os-interface => generated 282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Creating event network-changed:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:59:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057904 Nov 28 13:59:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 87/262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:21 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1f9d3ef6-103c-4dc2-8c3c-300f02257499 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0/ips" status: 200 len: 108 microversion: 2.1 time: 0.047073 Nov 28 13:59:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 88/263] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 13:59:21 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Invalid volume: volume ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 is already attached to instances: 949a3612-5042-420f-9911-ec641017d399 Nov 28 13:59:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 400 to user: Invalid volume: volume ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 is already attached to instances: 949a3612-5042-420f-9911-ec641017d399 {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c2b1921f-f4d3-49dd-86bc-4d3f94ca2445 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118359 Nov 28 13:59:22 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 89/264] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 13:59:22 2023] POST /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:59:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 204 len: 0 microversion: 2.1 time: 0.141983 Nov 28 13:59:22 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 13:59:22 2023] DELETE /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:22 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-9f64b757-1a7e-4171-9b21-936de213be23 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 200 len: 1549 microversion: 2.1 time: 0.361109 Nov 28 13:59:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 89/266] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:22 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 1549 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 13:59:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "name": "network-vif-deleted", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] Creating event network-vif-deleted:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:59:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057633 Nov 28 13:59:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:59:23 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "name": "network-vif-unplugged", "status": "completed", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}, {"server_uuid": "982e2518-5a29-4c35-b9e1-61e7401a4fd0", "name": "network-vif-plugged", "status": "completed", "tag": "f8bff86a-512f-4ff3-97fc-c35d36d68960"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:23 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Creating event network-vif-unplugged:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:59:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Creating event network-vif-plugged:f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 on user Nov 28 13:59:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.063089 Nov 28 13:59:23 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 89/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:23 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:25 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'services' on Instance uuid 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 13:59:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f/os-volume_attachments/56478f59-9340-4f10-83f7-bbeee4419867" status: 202 len: 0 microversion: 2.1 time: 0.297758 Nov 28 13:59:26 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 13:59:25 2023] DELETE /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f/os-volume_attachments/56478f59-9340-4f10-83f7-bbeee4419867 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 13:59:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f" status: 204 len: 0 microversion: 2.1 time: 0.232139 Nov 28 13:59:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 91/270] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 13:59:26 2023] DELETE /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:26 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a9dcfadd-1a8e-4a3c-bd16-b0267233e567 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f" status: 200 len: 1712 microversion: 2.1 time: 0.267191 Nov 28 13:59:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 90/271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:26 2023] GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f => generated 1712 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:59:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:59:33 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65026) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 13:59:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075697 Nov 28 13:59:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:35 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 13:59:35 user devstack@n-api.service[65027]: DEBUG nova.compute.api [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65027) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 13:59:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051938 Nov 28 13:59:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=114,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] HTTP exception thrown: Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b could not be found. Nov 28 13:59:40 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Returning 404 to user: Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-aa529d30-bd2b-4496-b835-de78f8be76fd tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 404 len: 111 microversion: 2.1 time: 0.055483 Nov 28 13:59:40 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 91/274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:40 2023] GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:41 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 13:59:41 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a68cbd0b-667d-4acc-86ab-2405baaf66dc tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1492 microversion: 2.1 time: 0.281578 Nov 28 13:59:41 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 92/275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:41 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1492 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 13:59:41 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0dd77420-3875-48ee-ae30-e50121c45f09 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Action: 'create', calling method: .version_select at 0x7fedf09e4280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-637479023"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:41 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0dd77420-3875-48ee-ae30-e50121c45f09 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.668063 Nov 28 13:59:41 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Nov 28 13:59:41 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 670 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 13:59:41 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0abb6d5c-2942-4561-ae36-45e89258dcee tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf053ec20>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:41 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0abb6d5c-2942-4561-ae36-45e89258dcee tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 200 len: 344 microversion: 2.1 time: 0.067637 Nov 28 13:59:41 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 92/277] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:41 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-78189b80-43c0-47af-81e7-c1730f79ebca tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf08eb7f0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-78189b80-43c0-47af-81e7-c1730f79ebca tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 200 len: 344 microversion: 2.1 time: 0.088232 Nov 28 13:59:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 93/278] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:42 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b43cab9b-8329-4f1c-8706-21ca3d99b293 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf0643490>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b43cab9b-8329-4f1c-8706-21ca3d99b293 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 200 len: 345 microversion: 2.1 time: 0.048309 Nov 28 13:59:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:44 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-be7faa54-33c7-40a6-82b2-46614547b6bb tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Action: 'create', calling method: .version_select at 0x7fedf053d7e0>, body: {"snapshot": {"volume_id": "18ba5a98-061f-441f-8520-96be56485cb9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-968318577"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-be7faa54-33c7-40a6-82b2-46614547b6bb tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.162731 Nov 28 13:59:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 93/280] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Nov 28 13:59:44 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-72d12bc7-a4ba-4b42-8d2e-d3ad9f8ca8cf tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf08e9d80>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-72d12bc7-a4ba-4b42-8d2e-d3ad9f8ca8cf tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.048545 Nov 28 13:59:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:44 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e3e2ab13-bf0c-4bf7-90fa-b7bdf39392f3 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf0643910>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e3e2ab13-bf0c-4bf7-90fa-b7bdf39392f3 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040256 Nov 28 13:59:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 13:59:44 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1e8732a0-fcce-44cb-b7e7-46ac5f273076 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf04160e0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1e8732a0-fcce-44cb-b7e7-46ac5f273076 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.046791 Nov 28 13:59:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 94/283] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:44 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] HTTP exception thrown: Instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d could not be found. Nov 28 13:59:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Returning 404 to user: Instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-9ad90e16-bc03-47dc-9678-fbb908f753e8 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d" status: 404 len: 111 microversion: 2.1 time: 0.033251 Nov 28 13:59:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 95/284] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 13:59:44 2023] GET /compute/v2.1/servers/57dc143b-7f7a-46e4-85c2-bed1c455b92d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 13:59:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-6f846b8b-1fbc-4af3-8545-f3a69e0be866 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Calling method '.version_select at 0x7fedf0643520>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:44 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-6f846b8b-1fbc-4af3-8545-f3a69e0be866 tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355928653" status: 202 len: 0 microversion: 2.1 time: 0.026600 Nov 28 13:59:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 13:59:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355928653 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:59:45 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4b129184-02bd-44ea-ae18-5d1bef4c97af tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf0646dd0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4b129184-02bd-44ea-ae18-5d1bef4c97af tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.039533 Nov 28 13:59:45 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 95/286] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:45 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-eec54e46-2e3a-41a9-bec9-eda296786fdb tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06af7f0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-eec54e46-2e3a-41a9-bec9-eda296786fdb tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.053505 Nov 28 13:59:46 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 96/287] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:46 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:47 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e3a75253-b839-479e-aedd-1f15cbabc1cf tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06d1120>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e3a75253-b839-479e-aedd-1f15cbabc1cf tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 287 microversion: 2.1 time: 0.053092 Nov 28 13:59:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 97/288] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:47 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 13:59:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-20fee15d-d3fb-4858-bc47-dee029191827 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf053d000>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-20fee15d-d3fb-4858-bc47-dee029191827 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 202 len: 0 microversion: 2.1 time: 0.110211 Nov 28 13:59:47 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 96/289] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 13:59:47 2023] DELETE /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:59:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a6a95ed0-7a15-4d67-9b29-23a2653dc266 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06af0a0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a6a95ed0-7a15-4d67-9b29-23a2653dc266 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.044451 Nov 28 13:59:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 97/290] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:47 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "name": "network-vif-unplugged", "status": "completed", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Creating event network-vif-unplugged:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:59:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030770 Nov 28 13:59:48 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 98/291] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-7508c57f-4189-4b05-a596-85914a98a185 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf053eb00>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-7508c57f-4189-4b05-a596-85914a98a185 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.040876 Nov 28 13:59:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 97/292] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:48 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-eaf7cfe4-68c3-4700-a448-776321b6fb61 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06aff40>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-eaf7cfe4-68c3-4700-a448-776321b6fb61 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.049583 Nov 28 13:59:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:49 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "name": "network-vif-deleted", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] Creating event network-vif-deleted:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:59:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029870 Nov 28 13:59:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bca975-80ab-4d17-8a2d-9435c5f9646f", "name": "network-vif-plugged", "status": "completed", "tag": "1543b940-0c84-4e66-b424-f3c6fbd8c737"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 13:59:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Creating event network-vif-plugged:1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f on user Nov 28 13:59:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049290 Nov 28 13:59:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 98/295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 13:59:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:50 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-56939ff7-b630-49a2-8158-5816892f3103 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06af7f0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-56939ff7-b630-49a2-8158-5816892f3103 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 200 len: 286 microversion: 2.1 time: 0.045057 Nov 28 13:59:50 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 99/296] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:50 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] HTTP exception thrown: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. Nov 28 13:59:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Returning 404 to user: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-81524b3e-5b51-45a4-9080-8795e81acd75 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 404 len: 111 microversion: 2.42 time: 0.026520 Nov 28 13:59:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 100/297] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:51 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8d61767e-4e3c-43da-82c9-45812683c469 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '.version_select at 0x7fedf053eb90>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3303a968-a932-4334-87ef-762d5a140187 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf08eba30>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-3303a968-a932-4334-87ef-762d5a140187 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] HTTP exception thrown: Snapshot 48c96ab1-382f-4e2a-8f24-87601066fcc8 could not be found. Nov 28 13:59:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3303a968-a932-4334-87ef-762d5a140187 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Returning 404 to user: Snapshot 48c96ab1-382f-4e2a-8f24-87601066fcc8 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3303a968-a932-4334-87ef-762d5a140187 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8" status: 404 len: 111 microversion: 2.1 time: 0.070745 Nov 28 13:59:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 13:59:51 2023] GET /compute/v2.1/os-snapshots/48c96ab1-382f-4e2a-8f24-87601066fcc8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 13:59:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8d61767e-4e3c-43da-82c9-45812683c469 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794267935" status: 204 len: 0 microversion: 2.42 time: 0.151986 Nov 28 13:59:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 99/299] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 13:59:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794267935 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 13:59:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-018b487d-19f1-4944-beff-a0b9e0cb721e tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06435b0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-018b487d-19f1-4944-beff-a0b9e0cb721e tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 202 len: 0 microversion: 2.1 time: 0.225645 Nov 28 13:59:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 13:59:52 2023] DELETE /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 13:59:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e856bdb5-6a67-46f3-bd68-be1b787cc754 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06afac0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e856bdb5-6a67-46f3-bd68-be1b787cc754 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 200 len: 344 microversion: 2.1 time: 0.053748 Nov 28 13:59:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 101/301] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:52 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:53 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2b8da463-feac-46f9-b5c8-3f2d44c15228 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf0414ca0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:53 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2b8da463-feac-46f9-b5c8-3f2d44c15228 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 200 len: 344 microversion: 2.1 time: 0.064093 Nov 28 13:59:53 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 100/302] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:53 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-acf74b03-dbf5-4345-bf9f-ebe68167a8e7 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf06d1480>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-acf74b03-dbf5-4345-bf9f-ebe68167a8e7 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 200 len: 344 microversion: 2.1 time: 0.065158 Nov 28 13:59:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:54 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=126,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-405d4ca0-1100-441c-ad42-37274fdd14f1 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf052d2d0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-405d4ca0-1100-441c-ad42-37274fdd14f1 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] HTTP exception thrown: Volume 18ba5a98-061f-441f-8520-96be56485cb9 could not be found. Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-405d4ca0-1100-441c-ad42-37274fdd14f1 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Returning 404 to user: Volume 18ba5a98-061f-441f-8520-96be56485cb9 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-405d4ca0-1100-441c-ad42-37274fdd14f1 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 404 len: 109 microversion: 2.1 time: 0.054892 Nov 28 13:59:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 102/304] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:55 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-dff90da7-aacf-4c62-8951-c2927bf1a5c8 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf0787010>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-dff90da7-aacf-4c62-8951-c2927bf1a5c8 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] HTTP exception thrown: Volume 18ba5a98-061f-441f-8520-96be56485cb9 could not be found. Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-dff90da7-aacf-4c62-8951-c2927bf1a5c8 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Returning 404 to user: Volume 18ba5a98-061f-441f-8520-96be56485cb9 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-dff90da7-aacf-4c62-8951-c2927bf1a5c8 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 404 len: 109 microversion: 2.1 time: 0.048210 Nov 28 13:59:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 13:59:55 2023] DELETE /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 13:59:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-618da9e2-04f5-4652-892e-d4c109932ef5 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Calling method '.version_select at 0x7fedf070fac0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-618da9e2-04f5-4652-892e-d4c109932ef5 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] HTTP exception thrown: Volume 18ba5a98-061f-441f-8520-96be56485cb9 could not be found. Nov 28 13:59:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-618da9e2-04f5-4652-892e-d4c109932ef5 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] Returning 404 to user: Volume 18ba5a98-061f-441f-8520-96be56485cb9 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-618da9e2-04f5-4652-892e-d4c109932ef5 tempest-VolumesSnapshotsTestJSON-98570624 tempest-VolumesSnapshotsTestJSON-98570624-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9" status: 404 len: 109 microversion: 2.1 time: 0.045353 Nov 28 13:59:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 13:59:55 2023] GET /compute/v2.1/os-volumes/18ba5a98-061f-441f-8520-96be56485cb9 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] HTTP exception thrown: Instance a9a21b61-5815-47ed-adac-040b1fc8e33a could not be found. Nov 28 13:59:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Returning 404 to user: Instance a9a21b61-5815-47ed-adac-040b1fc8e33a could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5c20a957-ab87-438c-ace9-36b80f93ebbf tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 404 len: 111 microversion: 2.49 time: 0.033284 Nov 28 13:59:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 103/307] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:55 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1417839d-2c66-4f67-9efe-64256918197a tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '.version_select at 0x7fedf06428c0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1417839d-2c66-4f67-9efe-64256918197a tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885537121" status: 204 len: 0 microversion: 2.49 time: 0.049917 Nov 28 13:59:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 104/308] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 13:59:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885537121 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 13:59:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] HTTP exception thrown: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. Nov 28 13:59:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Returning 404 to user: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8764bc7b-3460-4def-941d-56bdbacd22ef tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 404 len: 111 microversion: 2.42 time: 0.067054 Nov 28 13:59:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 102/309] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 13:59:55 2023] DELETE /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] HTTP exception thrown: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. Nov 28 13:59:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Returning 404 to user: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7b4628f9-5952-4c56-8be7-5e9b9c615ccd tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 10.0.0.210 "GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370" status: 404 len: 111 microversion: 2.42 time: 0.054907 Nov 28 13:59:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 104/310] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:55 2023] GET /compute/v2.1/servers/794937d9-3c23-41cf-bb74-767e93bc1370 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] HTTP exception thrown: Instance a9a21b61-5815-47ed-adac-040b1fc8e33a could not be found. Nov 28 13:59:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Returning 404 to user: Instance a9a21b61-5815-47ed-adac-040b1fc8e33a could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-63bba62d-7005-4df9-b50d-978034032f3c tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 404 len: 111 microversion: 2.49 time: 0.052599 Nov 28 13:59:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 105/311] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 13:59:58 2023] DELETE /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 13:59:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] HTTP exception thrown: Instance a9a21b61-5815-47ed-adac-040b1fc8e33a could not be found. Nov 28 13:59:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Returning 404 to user: Instance a9a21b61-5815-47ed-adac-040b1fc8e33a could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 13:59:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-3e93ac85-6f61-48df-98d2-d38691a811ec tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a" status: 404 len: 111 microversion: 2.49 time: 0.031497 Nov 28 13:59:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 103/312] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 13:59:58 2023] GET /compute/v2.1/servers/a9a21b61-5815-47ed-adac-040b1fc8e33a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:02 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a00a3cc1-b3ad-4d52-9bd8-a11ea4130ff9 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1699 microversion: 2.1 time: 0.736970 Nov 28 14:00:02 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 105/313] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:01 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1699 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:04 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4e2194d8-1941-4189-8371-cefcc3e24f04 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1711 microversion: 2.1 time: 1.092448 Nov 28 14:00:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 106/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:03 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1711 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:00:12 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:12 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 could not be found. Nov 28 14:00:13 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-65a35c59-4bba-4228-8676-0a456e2435ad tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 404 len: 111 microversion: 2.1 time: 0.323253 Nov 28 14:00:13 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:12 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 111 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:00:13 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:13 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:13 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-94a5fbeb-c9c7-42ec-a202-9ce794dca364 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '.version_select at 0x7fedf052f0a0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-94a5fbeb-c9c7-42ec-a202-9ce794dca364 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167956881" status: 202 len: 0 microversion: 2.1 time: 0.040597 Nov 28 14:00:13 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:00:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167956881 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3fe17e83-4aea-408e-bc9c-fb2ad47f6bc4 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Action: 'create', calling method: .version_select at 0x7fedf06d15a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1422157714", "metadata": {"Type": "work"}}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3fe17e83-4aea-408e-bc9c-fb2ad47f6bc4 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3fe17e83-4aea-408e-bc9c-fb2ad47f6bc4 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149983 Nov 28 14:00:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 14:00:14 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fb03b7b1-ab5f-46f8-91a9-88d86c991dcc tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Action: 'create', calling method: .version_select at 0x7fedf0414310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1412133429", "metadata": {"Type": "work"}}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fb03b7b1-ab5f-46f8-91a9-88d86c991dcc tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fb03b7b1-ab5f-46f8-91a9-88d86c991dcc tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014750 Nov 28 14:00:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 105/318] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 14:00:14 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4c62caf1-3cbb-4b04-a593-cd87afcd806b tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Action: 'create', calling method: .version_select at 0x7fedf06ad5a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-63414742", "metadata": {"Type": "work"}}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4c62caf1-3cbb-4b04-a593-cd87afcd806b tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4c62caf1-3cbb-4b04-a593-cd87afcd806b tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007444 Nov 28 14:00:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 107/319] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 14:00:14 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-33bbd0d2-683e-47b0-a9a3-494cd33e53e3 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Calling method '.version_select at 0x7fedf06d2e60>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-33bbd0d2-683e-47b0-a9a3-494cd33e53e3 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] HTTP exception thrown: Volume tempest-invalid-1492702331 could not be found. Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-33bbd0d2-683e-47b0-a9a3-494cd33e53e3 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Returning 404 to user: Volume tempest-invalid-1492702331 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-33bbd0d2-683e-47b0-a9a3-494cd33e53e3 tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1492702331" status: 404 len: 99 microversion: 2.1 time: 0.163257 Nov 28 14:00:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:00:14 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1492702331 => generated 99 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a0e44cb9-e7ff-4e91-bc86-663db0fb436a tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004194 Nov 28 14:00:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 106/321] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 14:00:14 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-21de5da8-675a-4240-a195-fdff7d189b0b tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006593 Nov 28 14:00:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Nov 28 14:00:14 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c22815f4-9825-4dc2-9e61-85c8b968424a tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Calling method '.version_select at 0x7fedf0896dd0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-c22815f4-9825-4dc2-9e61-85c8b968424a tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] HTTP exception thrown: Volume bef8a052-8eae-4221-8c9a-b8d4da334bfa could not be found. Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c22815f4-9825-4dc2-9e61-85c8b968424a tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Returning 404 to user: Volume bef8a052-8eae-4221-8c9a-b8d4da334bfa could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c22815f4-9825-4dc2-9e61-85c8b968424a tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/bef8a052-8eae-4221-8c9a-b8d4da334bfa" status: 404 len: 109 microversion: 2.1 time: 0.039848 Nov 28 14:00:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 14:00:14 2023] DELETE /compute/v2.1/os-volumes/bef8a052-8eae-4221-8c9a-b8d4da334bfa => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3c11ccdb-b6c2-4b13-b2a4-8724e8020f5f tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Calling method '.version_select at 0x7fedf0414040>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-3c11ccdb-b6c2-4b13-b2a4-8724e8020f5f tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] HTTP exception thrown: Volume 86bd0315-972e-4fa6-bc16-5358624d6480 could not be found. Nov 28 14:00:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3c11ccdb-b6c2-4b13-b2a4-8724e8020f5f tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] Returning 404 to user: Volume 86bd0315-972e-4fa6-bc16-5358624d6480 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-3c11ccdb-b6c2-4b13-b2a4-8724e8020f5f tempest-VolumesNegativeTest-1171003348 tempest-VolumesNegativeTest-1171003348-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/86bd0315-972e-4fa6-bc16-5358624d6480" status: 404 len: 109 microversion: 2.1 time: 0.120663 Nov 28 14:00:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:00:14 2023] GET /compute/v2.1/os-volumes/86bd0315-972e-4fa6-bc16-5358624d6480 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'services' on Instance uuid 949a3612-5042-420f-9911-ec641017d399 {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:00:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments/ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6" status: 202 len: 0 microversion: 2.1 time: 0.272106 Nov 28 14:00:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:00:14 2023] DELETE /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments/ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=14 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-89f45f5b-ed0c-4793-a43c-c6c6a5f7e5bd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064885 Nov 28 14:00:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:00:14 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] HTTP exception thrown: Instance 21bca975-80ab-4d17-8a2d-9435c5f9646f could not be found. Nov 28 14:00:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Returning 404 to user: Instance 21bca975-80ab-4d17-8a2d-9435c5f9646f could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1e5a6d40-9932-4eea-af2e-f4df0d07bde0 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f" status: 404 len: 111 microversion: 2.1 time: 0.047238 Nov 28 14:00:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:16 2023] GET /compute/v2.1/servers/21bca975-80ab-4d17-8a2d-9435c5f9646f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:00:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c4a5060d-586a-4b01-96e7-358bda3e7c0d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '.version_select at 0x7fedf06aecb0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c4a5060d-586a-4b01-96e7-358bda3e7c0d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571158505" status: 202 len: 0 microversion: 2.1 time: 0.023818 Nov 28 14:00:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:00:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571158505 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f5ddc4eb-5190-48b5-9460-f27a2ced372c"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] HTTP exception thrown: Volume de1f6c04-8b97-4899-b850-f72245260f01 could not be found. Nov 28 14:00:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] Returning 404 to user: Volume de1f6c04-8b97-4899-b850-f72245260f01 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a29f7ee6-0cf0-4b64-87f2-2dcc8e238115 tempest-VolumesAdminNegativeTest-74835539 tempest-VolumesAdminNegativeTest-74835539-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2/os-volume_attachments/de1f6c04-8b97-4899-b850-f72245260f01" status: 404 len: 109 microversion: 2.1 time: 0.112813 Nov 28 14:00:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 111/329] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 14:00:17 2023] PUT /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2/os-volume_attachments/de1f6c04-8b97-4899-b850-f72245260f01 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:00:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-118e4920-ad26-415d-8f13-bc6bc324c464 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Action: 'create', calling method: .version_select at 0x7fedf04167a0>, body: {"keypair": {"name": "tempest-keypair-601378316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLdh5KkZs2uRczkjfWNP8lhnjvPNkrz2kWYuh21IhX5LJ6HVeqLmAMoelvP7qtY4O1o8zNE86kmj07w3j5Qds7nQiYacJk1xc9F2fBooepoKUgkZbjcARaG+b/u9MMGIw=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:17 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-118e4920-ad26-415d-8f13-bc6bc324c464 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Getting quotas for project 24b30ed6146c4a7f82b357d83df9e88b. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:17 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-118e4920-ad26-415d-8f13-bc6bc324c464 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Getting quotas for user 1bda47eaf5e34007aacf101594a9a158 and project 24b30ed6146c4a7f82b357d83df9e88b. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-118e4920-ad26-415d-8f13-bc6bc324c464 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.313517 Nov 28 14:00:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 109/330] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:00:17 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1717889095", "imageRef": "4c805d98-1957-42b5-99d6-f6b4807c6557", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "5e9f6cb3-94c3-4518-9eba-ec555278d020"}], "security_groups": [{"name": "tempest-securitygroup--19391304"}], "key_name": "tempest-keypair-601378316", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:20 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] validate_networks() for [('5e9f6cb3-94c3-4518-9eba-ec555278d020', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:21 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:00:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2" status: 204 len: 0 microversion: 2.1 time: 0.159308 Nov 28 14:00:21 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 112/331] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:00:21 2023] DELETE /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:21 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-df8472c4-b498-41f1-b28f-08628f0e5326 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2" status: 200 len: 1500 microversion: 2.1 time: 0.472633 Nov 28 14:00:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 110/332] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:21 2023] GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2 => generated 1500 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Getting quotas for project 24b30ed6146c4a7f82b357d83df9e88b. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Getting quotas for user 1bda47eaf5e34007aacf101594a9a158 and project 24b30ed6146c4a7f82b357d83df9e88b. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:00:21 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c805d98-1957-42b5-99d6-f6b4807c6557',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:00:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.569054 Nov 28 14:00:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 111/333] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:00:20 2023] POST /compute/v2.1/servers => generated 402 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:00:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-68f856b3-90f7-4efb-93d8-7ee85e7f526f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:22 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-68f856b3-90f7-4efb-93d8-7ee85e7f526f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:22 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-68f856b3-90f7-4efb-93d8-7ee85e7f526f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bda47eaf5e34007aacf101594a9a158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b30ed6146c4a7f82b357d83df9e88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-68f856b3-90f7-4efb-93d8-7ee85e7f526f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 200 len: 1237 microversion: 2.1 time: 0.127868 Nov 28 14:00:22 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 113/334] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:22 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:00:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51b39c5-001f-4f76-93c0-145fd3373cc2", "name": "network-vif-deleted", "tag": "70e39897-4a33-4d71-a525-84ce5c721830"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] Creating event network-vif-deleted:70e39897-4a33-4d71-a525-84ce5c721830 for instance a51b39c5-001f-4f76-93c0-145fd3373cc2 on user Nov 28 14:00:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051688 Nov 28 14:00:22 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 111/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:26 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Creating event network-changed:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:00:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240710 Nov 28 14:00:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-06913555-3572-498f-998d-00260670bcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Action: 'create', calling method: .version_select at 0x7fedf06d0820>, body: {"keypair": {"name": "tempest-keypair-1958037787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:29 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-06913555-3572-498f-998d-00260670bcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting quotas for project cbf581e03a6c4f678536c9d64fe4b8cc. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:29 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-06913555-3572-498f-998d-00260670bcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting quotas for user 1406382a40d841b5a59d791ec6744fc4 and project cbf581e03a6c4f678536c9d64fe4b8cc. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-06913555-3572-498f-998d-00260670bcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.93 time: 0.171851 Nov 28 14:00:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 114/337] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 14:00:29 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 14:00:30 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "name": "network-vif-plugged", "status": "completed", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Creating event network-vif-plugged:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:00:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218687 Nov 28 14:00:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 112/338] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "name": "network-vif-plugged", "status": "completed", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Creating event network-vif-plugged:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:00:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072531 Nov 28 14:00:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 113/339] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e8589a74-d825-4389-86f4-d86f474879ab tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'create', calling method: .version_select at 0x7fedf06d2b00>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-423384039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:34 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:34 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-e8589a74-d825-4389-86f4-d86f474879ab tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for project f4056ca714ed4e85878d7819ef63b20c. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:34 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-e8589a74-d825-4389-86f4-d86f474879ab tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for user e109047aa8a34d8aad03c6c0dc14c7c8 and project f4056ca714ed4e85878d7819ef63b20c. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e8589a74-d825-4389-86f4-d86f474879ab tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053288 Nov 28 14:00:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 115/340] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:00:34 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:34 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1236309658", "imageRef": "13624d8f-7316-4efc-8993-8da1904872d5", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-423384039", "networks": [{"uuid": "ba428b8f-0c0f-4327-be18-5f08025368bf"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:34 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] validate_networks() for [('ba428b8f-0c0f-4327-be18-5f08025368bf', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for project f4056ca714ed4e85878d7819ef63b20c. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for user e109047aa8a34d8aad03c6c0dc14c7c8 and project f4056ca714ed4e85878d7819ef63b20c. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:35 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d5bea5fb-2f6a-4387-a73a-7deca9c5b5b6 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Action: 'create', calling method: .version_select at 0x7fedf08e9900>, body: {"keypair": {"name": "tempest-keypair-89595986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo93KyRIyDIx6msms3X4P0mECSBfI9u3++xg2wVl/gdDfGrNn7vnL5Abe2nYoJ2jZ7cHhRdKoOxjhf3EPdGbXLAD8XisKL8EhjC44s9aWuBca2URk7mIofayLyn9T2BTA=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:00:35 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-d5bea5fb-2f6a-4387-a73a-7deca9c5b5b6 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:35 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='13624d8f-7316-4efc-8993-8da1904872d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:00:35 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-d5bea5fb-2f6a-4387-a73a-7deca9c5b5b6 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for user 570ac6978fc249ba93d39e40d5d7eac7 and project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:35 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d5bea5fb-2f6a-4387-a73a-7deca9c5b5b6 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.062075 Nov 28 14:00:35 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 114/341] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:00:35 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.751429 Nov 28 14:00:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 113/342] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:00:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:00:35 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d9005cea-5bdf-45a2-a1b4-5b7be48184bd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:35 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d9005cea-5bdf-45a2-a1b4-5b7be48184bd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:35 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-d9005cea-5bdf-45a2-a1b4-5b7be48184bd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d9005cea-5bdf-45a2-a1b4-5b7be48184bd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1250 microversion: 2.1 time: 0.073221 Nov 28 14:00:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 116/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:35 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1250 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:00:37 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1158935620", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877"}], "security_groups": [{"name": "tempest-securitygroup--288408662"}], "key_name": "tempest-keypair-89595986", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:37 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] validate_networks() for [('2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting quotas for user 570ac6978fc249ba93d39e40d5d7eac7 and project ff4bdacb213b463cb88e3d046e931b9d. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:00:38 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:00:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-1576957829", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "c97ad9fa-d1d9-4437-99e9-6a2856546feb"}], "security_groups": [{"name": "tempest-securitygroup--1075171198"}], "key_name": "tempest-keypair-1958037787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0bbc90b3-d676-465d-8b27-6af2a82d5055", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.958878 Nov 28 14:00:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 115/344] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:00:37 2023] POST /compute/v2.1/servers => generated 403 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:00:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f088348d-5737-4f51-a81c-334067ff4bdf tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:38 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f088348d-5737-4f51-a81c-334067ff4bdf tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:38 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-f088348d-5737-4f51-a81c-334067ff4bdf tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f088348d-5737-4f51-a81c-334067ff4bdf tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" status: 200 len: 1233 microversion: 2.1 time: 0.122892 Nov 28 14:00:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:38 2023] GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 => generated 1233 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:00:38 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] validate_networks() for [('c97ad9fa-d1d9-4437-99e9-6a2856546feb', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:39 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting quotas for project cbf581e03a6c4f678536c9d64fe4b8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:00:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting quotas for user 1406382a40d841b5a59d791ec6744fc4 and project cbf581e03a6c4f678536c9d64fe4b8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:00:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Creating event network-changed:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:00:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046678 Nov 28 14:00:39 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:00:39 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bbc90b3-d676-465d-8b27-6af2a82d5055',volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:00:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.93 time: 1.574597 Nov 28 14:00:39 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 114/347] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:00:38 2023] POST /compute/v2.1/servers => generated 407 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:00:39 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a1c3b137-2212-4ea5-b8a4-5b02dcfdbcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:39 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a1c3b137-2212-4ea5-b8a4-5b02dcfdbcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:40 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a1c3b137-2212-4ea5-b8a4-5b02dcfdbcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:40 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a1c3b137-2212-4ea5-b8a4-5b02dcfdbcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:40 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a1c3b137-2212-4ea5-b8a4-5b02dcfdbcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a1c3b137-2212-4ea5-b8a4-5b02dcfdbcad tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1334 microversion: 2.93 time: 0.124868 Nov 28 14:00:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 118/348] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:00:39 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1334 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:00:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-plugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Creating event network-vif-plugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:00:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038104 Nov 28 14:00:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Creating event network-changed:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:00:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065984 Nov 28 14:00:43 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 115/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9eb7ce8d-7383-4e94-a0e1-a8124afc0ae0 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1374295427", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ac12450f-cbff-42b7-a82b-054930c2d62e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "73322956-2161-4c75-88f6-ddf480017fbe"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-9eb7ce8d-7383-4e94-a0e1-a8124afc0ae0 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] HTTP exception thrown: Block Device ac12450f-cbff-42b7-a82b-054930c2d62e is not bootable. Nov 28 14:00:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9eb7ce8d-7383-4e94-a0e1-a8124afc0ae0 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Returning 400 to user: Block Device ac12450f-cbff-42b7-a82b-054930c2d62e is not bootable. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:00:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9eb7ce8d-7383-4e94-a0e1-a8124afc0ae0 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.087956 Nov 28 14:00:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 119/351] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:00:44 2023] POST /compute/v2.1/servers => generated 110 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}, {"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-plugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Creating event network-changed:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:00:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Creating event network-vif-plugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:00:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039850 Nov 28 14:00:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 116/352] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:44 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:00:45 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:00:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-077ab5c3-e34c-40a2-abeb-c10a0c261123 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1492 microversion: 2.1 time: 0.703056 Nov 28 14:00:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 118/353] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:00:44 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1492 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:00:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "name": "network-vif-plugged", "status": "completed", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Creating event network-vif-plugged:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:00:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054305 Nov 28 14:00:45 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 120/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "name": "network-vif-plugged", "status": "completed", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Creating event network-vif-plugged:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:00:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037654 Nov 28 14:00:47 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 117/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Creating event network-vif-plugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:00:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Nov 28 14:00:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 119/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=16 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:00:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:00:56 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Creating event network-vif-plugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:00:56 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053452 Nov 28 14:00:56 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 121/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=12 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=7 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=24 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:03 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'services' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:01:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-volume_attachments/a6dd3f41-6624-4976-8316-6d52ce2c4373" status: 202 len: 0 microversion: 2.1 time: 0.240855 Nov 28 14:01:03 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 118/358] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:01:03 2023] DELETE /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-volume_attachments/a6dd3f41-6624-4976-8316-6d52ce2c4373 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/action" status: 202 len: 0 microversion: 2.1 time: 0.231169 Nov 28 14:01:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 120/359] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:01:04 2023] POST /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f71f4f59-2c48-43ba-b110-8fec557d8f66 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060307 Nov 28 14:01:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 119/360] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:01:05 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:05 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b2ed6bb2-5411-460a-ac73-28a1d1dd26e2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1710 microversion: 2.1 time: 0.275456 Nov 28 14:01:05 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 122/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:04 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1710 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:01:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 204 len: 0 microversion: 2.1 time: 0.133466 Nov 28 14:01:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 121/362] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:01:05 2023] DELETE /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-be7598a4-4490-4405-9587-9b871d2ba468 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 200 len: 1667 microversion: 2.1 time: 0.372977 Nov 28 14:01:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 120/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:05 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 1667 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:05 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a3612-5042-420f-9911-ec641017d399", "name": "network-vif-unplugged", "status": "completed", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Creating event network-vif-unplugged:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 14:01:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179084 Nov 28 14:01:05 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 123/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-unplugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Creating event network-vif-unplugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:01:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65026) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 14:01:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042779 Nov 28 14:01:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 122/365] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:01:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a3612-5042-420f-9911-ec641017d399", "name": "network-vif-plugged", "status": "completed", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Creating event network-vif-plugged:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 14:01:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044226 Nov 28 14:01:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 121/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}, {"server_uuid": "949a3612-5042-420f-9911-ec641017d399", "name": "network-vif-deleted", "tag": "c4432eb7-3703-49b9-afd1-534fdd4065b4"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:01:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Creating event network-vif-deleted:c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance 949a3612-5042-420f-9911-ec641017d399 on user Nov 28 14:01:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65027) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 14:01:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118239 Nov 28 14:01:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] HTTP exception thrown: Instance a51b39c5-001f-4f76-93c0-145fd3373cc2 could not be found. Nov 28 14:01:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Returning 404 to user: Instance a51b39c5-001f-4f76-93c0-145fd3373cc2 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:01:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3aa345f8-4139-47fb-8c03-96f2e578e4e8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2" status: 404 len: 111 microversion: 2.1 time: 0.034117 Nov 28 14:01:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 123/368] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:11 2023] GET /compute/v2.1/servers/a51b39c5-001f-4f76-93c0-145fd3373cc2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:12 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bda47eaf5e34007aacf101594a9a158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b30ed6146c4a7f82b357d83df9e88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:12 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2f281e45-c306-4b91-a47c-5cfd7cbac80f tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 200 len: 1546 microversion: 2.1 time: 0.348963 Nov 28 14:01:12 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 122/369] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:12 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 1546 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:01:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6" status: 204 len: 0 microversion: 2.1 time: 0.136078 Nov 28 14:01:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 125/370] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:01:16 2023] DELETE /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:16 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e948c52e-cd85-4ba1-b02c-afd6dd6db8e1 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6" status: 200 len: 1666 microversion: 2.1 time: 0.291738 Nov 28 14:01:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 124/371] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:16 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6 => generated 1666 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-unplugged", "status": "completed", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Creating event network-vif-unplugged:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 14:01:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033916 Nov 28 14:01:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 123/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-deleted", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] Creating event network-vif-deleted:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 14:01:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033451 Nov 28 14:01:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 126/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-plugged", "status": "completed", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}, {"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-plugged", "status": "completed", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}, {"server_uuid": "3907babd-71af-4fca-8ad7-4a7dae1710d6", "name": "network-vif-plugged", "status": "completed", "tag": "b0710703-b905-47cd-bf04-c07eb065364e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Creating event network-vif-plugged:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 14:01:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Creating event network-vif-plugged:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 14:01:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Creating event network-vif-plugged:b0710703-b905-47cd-bf04-c07eb065364e for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 on user Nov 28 14:01:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054635 Nov 28 14:01:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 125/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d2917636-847d-4f3e-82eb-82a38dbeb249 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1533 microversion: 2.1 time: 0.374396 Nov 28 14:01:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:25 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1533 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:01:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030807 Nov 28 14:01:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 127/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:26 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:26 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Going to try to stop instance {{(pid=65026) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 14:01:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action" status: 202 len: 0 microversion: 2.1 time: 0.148787 Nov 28 14:01:26 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 126/377] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:01:26 2023] POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:26 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-382e2b02-bb36-41af-9416-528c5b9c42ab tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1663 microversion: 2.1 time: 0.298383 Nov 28 14:01:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:26 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1663 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:27 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-81be7562-e578-44b2-988e-04fc921062c8 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Action: 'create', calling method: .version_select at 0x7fedf070f010>, body: {"keypair": {"name": "tempest-TestShelveInstance-1470109784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6z3du+pmuEBKboST02586Of9o2SE842jAb049GFnMxRW83rmvet7dpNb4t0VRkhFGxC/tIx+XacRSvu0RJvjpQharev3k6UhzGalKPyeiOSo5afml9y35O1EfkG0ODGQ=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:27 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-81be7562-e578-44b2-988e-04fc921062c8 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting quotas for project d5606d16b2f44aa0a189a0b20d687cbc. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:01:27 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-81be7562-e578-44b2-988e-04fc921062c8 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting quotas for user 6f9c41c5c12e4ce0b5848dc319ceff1d and project d5606d16b2f44aa0a189a0b20d687cbc. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:01:27 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-81be7562-e578-44b2-988e-04fc921062c8 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.464195 Nov 28 14:01:27 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 128/379] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:01:27 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}, {"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-unplugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}, {"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:01:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Creating event network-vif-unplugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:01:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:01:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040930 Nov 28 14:01:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 127/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:28 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:28 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c5dd8a7f-82f9-4c19-9aec-5da4d9f942fe tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" status: 200 len: 1540 microversion: 2.1 time: 0.272104 Nov 28 14:01:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 126/381] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:28 2023] GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 => generated 1540 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:30 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7968212d-2f43-4d71-94e5-391e57acaa0d tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1723 microversion: 2.93 time: 0.369882 Nov 28 14:01:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 129/382] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:01:30 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8b755899-324f-4551-8967-c4ea46b885fd tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Nov 28 14:01:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 128/383] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:01:33 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:01:34 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2" status: 204 len: 0 microversion: 2.1 time: 0.127107 Nov 28 14:01:34 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 127/384] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:01:34 2023] DELETE /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:34 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf1fd2414db4fb9a5006cc8f5441745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65587be998440ed8f615dcb2f8f0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-dbee6638-0c83-49b4-ba76-040da7937786 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2" status: 200 len: 1693 microversion: 2.1 time: 0.246010 Nov 28 14:01:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:34 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2 => generated 1693 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:34 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Creating event network-vif-unplugged:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 14:01:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028936 Nov 28 14:01:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:01:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1023395681", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-1470109784", "security_groups": [{"name": "tempest-secgroup-smoke-1826391058"}], "networks": [{"uuid": "e4b10530-95db-4de1-b927-6b73d44996b1"}], "block_device_mapping_v2": [{"uuid": "f30f0930-b3ec-4e8d-99ae-cd205eb43c59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:35 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] validate_networks() for [('e4b10530-95db-4de1-b927-6b73d44996b1', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:36 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "name": "network-vif-plugged", "status": "completed", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting quotas for project d5606d16b2f44aa0a189a0b20d687cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting quotas for user 6f9c41c5c12e4ce0b5848dc319ceff1d and project d5606d16b2f44aa0a189a0b20d687cbc. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:01:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:36 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Creating event network-vif-plugged:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 14:01:36 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035374 Nov 28 14:01:36 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 131/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:01:36 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f30f0930-b3ec-4e8d-99ae-cd205eb43c59',volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:01:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.251789 Nov 28 14:01:36 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 128/388] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:01:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:01:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f606562d-52eb-4ade-bbff-dc41625fb6a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:36 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f606562d-52eb-4ade-bbff-dc41625fb6a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:36 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-f606562d-52eb-4ade-bbff-dc41625fb6a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f606562d-52eb-4ade-bbff-dc41625fb6a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1082 microversion: 2.1 time: 0.067135 Nov 28 14:01:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:36 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1082 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c010a7-3604-41c4-9599-d41172a28fe2", "name": "network-vif-deleted", "tag": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:38 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] Creating event network-vif-deleted:1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance 66c010a7-3604-41c4-9599-d41172a28fe2 on user Nov 28 14:01:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032379 Nov 28 14:01:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 132/390] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:40 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Creating event network-changed:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:01:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031412 Nov 28 14:01:40 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 129/391] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:45 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-99a750fc-7e07-4dea-be5f-1d83ef97a23b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1492 microversion: 2.1 time: 0.227258 Nov 28 14:01:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:45 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1492 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-plugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Creating event network-vif-plugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:01:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061529 Nov 28 14:01:48 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 133/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-plugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Creating event network-vif-plugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:01:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048062 Nov 28 14:01:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:01:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-189cbaa2-6252-4468-87af-c3a258498ca4 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1703 microversion: 2.1 time: 0.202346 Nov 28 14:01:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 132/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:55 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1703 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 949a3612-5042-420f-9911-ec641017d399 could not be found. Nov 28 14:01:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 949a3612-5042-420f-9911-ec641017d399 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:01:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-dc294bd5-1f63-4b70-8bdc-c790cff0fb16 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 404 len: 111 microversion: 2.1 time: 0.027271 Nov 28 14:01:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 134/396] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:55 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:01:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2daa7944-fb95-4b3b-96f2-2270e7d6943a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '.version_select at 0x7fedf0785870>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2daa7944-fb95-4b3b-96f2-2270e7d6943a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064566278" status: 202 len: 0 microversion: 2.1 time: 0.025082 Nov 28 14:01:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 131/397] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:01:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064566278 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:01:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-bef60c8d-8ad7-46bb-abfd-d0898bf51eff tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: .version_select at 0x7fedf052e170>, body: {"keypair": {"name": "tempest-keypair-1356044097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgIoKRVSV5nMNqKEgIQf0W5MKotAydNA66TSyhlYX6P4EK7Qo0KESqOWiHQOWd4ZAUh5eftROfsJT5+OoKZQ8vCa3ADu1/YgEh40c7+yO222qyd2ZPAI5I1imtXJod6iA=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:56 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-bef60c8d-8ad7-46bb-abfd-d0898bf51eff tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:01:56 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-bef60c8d-8ad7-46bb-abfd-d0898bf51eff tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:01:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-bef60c8d-8ad7-46bb-abfd-d0898bf51eff tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043812 Nov 28 14:01:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 133/398] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:01:56 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:01:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1926298954", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7"}], "security_groups": [{"name": "tempest-securitygroup--1415539593"}], "key_name": "tempest-keypair-1356044097", "user_data": "}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:01:57 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] validate_networks() for [('eb697d01-87f7-4768-84bb-0e25fdf0c3e7', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:01:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:01:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.766507 Nov 28 14:01:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 135/399] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:01:57 2023] POST /compute/v2.1/servers => generated 400 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:01:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-eadb987b-e9b7-40e4-80f1-740ab7d8227f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:01:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-eadb987b-e9b7-40e4-80f1-740ab7d8227f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:01:58 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-eadb987b-e9b7-40e4-80f1-740ab7d8227f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:01:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-eadb987b-e9b7-40e4-80f1-740ab7d8227f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 200 len: 1234 microversion: 2.1 time: 0.066373 Nov 28 14:01:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:01:58 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa772d7-ca30-4a90-b326-3450f9e28784", "tag": "d38482f3-db24-4172-a831-de471ef45c2b"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Creating event network-changed:d38482f3-db24-4172-a831-de471ef45c2b for instance 3aa772d7-ca30-4a90-b326-3450f9e28784 on user Nov 28 14:02:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032550 Nov 28 14:02:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa772d7-ca30-4a90-b326-3450f9e28784", "name": "network-vif-plugged", "status": "completed", "tag": "d38482f3-db24-4172-a831-de471ef45c2b"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Creating event network-vif-plugged:d38482f3-db24-4172-a831-de471ef45c2b for instance 3aa772d7-ca30-4a90-b326-3450f9e28784 on user Nov 28 14:02:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Nov 28 14:02:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 136/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:05 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa772d7-ca30-4a90-b326-3450f9e28784", "name": "network-vif-plugged", "status": "completed", "tag": "d38482f3-db24-4172-a831-de471ef45c2b"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:05 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:05 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:05 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Creating event network-vif-plugged:d38482f3-db24-4172-a831-de471ef45c2b for instance 3aa772d7-ca30-4a90-b326-3450f9e28784 on user Nov 28 14:02:05 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034015 Nov 28 14:02:05 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 133/403] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] HTTP exception thrown: Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 could not be found. Nov 28 14:02:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Returning 404 to user: Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:02:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-54fe649e-f7d1-4712-b24b-22aa886a2852 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6" status: 404 len: 111 microversion: 2.1 time: 0.038530 Nov 28 14:02:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:06 2023] GET /compute/v2.1/servers/3907babd-71af-4fca-8ad7-4a7dae1710d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:02:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-896c2b3a-fa11-4dfe-9193-ae42960317bc tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Calling method '.version_select at 0x7fedf06d0ee0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:06 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-896c2b3a-fa11-4dfe-9193-ae42960317bc tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776308576" status: 202 len: 0 microversion: 2.1 time: 0.026279 Nov 28 14:02:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:02:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776308576 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:12 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-90aeabbb-264c-4197-b59a-442db6e1936b tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.303000 Nov 28 14:02:12 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 134/406] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:02:12 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-interface => generated 283 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Creating event network-changed:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:02:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030052 Nov 28 14:02:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dfd2051-f1a1-44d0-967f-cfab350bd0ca"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:17 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b29fcddc-c64a-4eec-b96b-79ee39f2e07d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1640 microversion: 2.1 time: 0.410382 Nov 28 14:02:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:16 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1640 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345927 Nov 28 14:02:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 135/409] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:02:16 2023] POST /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1739476838", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb"}]}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:22 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] validate_networks() for [('8b43f52b-7c66-43d0-a042-a7cbace5ffcb', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Getting quotas for project 5cec039db477464e97d27271375d7787. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Getting quotas for user f72e0ee68948479fa09697af3cf24b4b and project 5cec039db477464e97d27271375d7787. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:02:23 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:02:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.717155 Nov 28 14:02:23 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 137/410] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:02:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:02:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9ceb1202-c400-46a9-84c9-184a1a596b75 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:23 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9ceb1202-c400-46a9-84c9-184a1a596b75 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:23 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-9ceb1202-c400-46a9-84c9-184a1a596b75 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e0ee68948479fa09697af3cf24b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cec039db477464e97d27271375d7787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9ceb1202-c400-46a9-84c9-184a1a596b75 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 200 len: 1207 microversion: 2.1 time: 0.062011 Nov 28 14:02:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:23 2023] GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 1207 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] HTTP exception thrown: Instance 66c010a7-3604-41c4-9599-d41172a28fe2 could not be found. Nov 28 14:02:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Returning 404 to user: Instance 66c010a7-3604-41c4-9599-d41172a28fe2 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:02:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e5748819-52b6-4782-b5af-74605f84fa37 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2" status: 404 len: 111 microversion: 2.1 time: 0.076891 Nov 28 14:02:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:24 2023] GET /compute/v2.1/servers/66c010a7-3604-41c4-9599-d41172a28fe2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:02:24 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4bd6cadd-1893-452f-9fc7-bace47a1e52d tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Calling method '.version_select at 0x7fedf052fc70>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:24 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4bd6cadd-1893-452f-9fc7-bace47a1e52d tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888199441" status: 202 len: 0 microversion: 2.1 time: 0.026333 Nov 28 14:02:24 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:02:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888199441 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:02:25 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3e50a0-3428-42c7-aee0-baa85761b734", "tag": "af80811d-0d53-4367-88e4-0a688c183350"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Creating event network-changed:af80811d-0d53-4367-88e4-0a688c183350 for instance 2d3e50a0-3428-42c7-aee0-baa85761b734 on user Nov 28 14:02:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035304 Nov 28 14:02:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 140/414] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e6122bd3-19f8-45fd-ad04-3dc36a84fb32 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1533 microversion: 2.1 time: 0.239838 Nov 28 14:02:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 137/415] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:26 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1533 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching by: {'deleted': False, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c'} {{(pid=65026) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65026]: DEBUG nova.compute.multi_cell_list [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65026) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 14:02:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5253335e-5d3d-478e-a25b-85f636b5122f tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.166295 Nov 28 14:02:26 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 14:02:26 2023] GET /compute/v2.1/servers => generated 341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-2e460eae-ccf4-4112-8e8b-f028b40d4282 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1533 microversion: 2.1 time: 0.212110 Nov 28 14:02:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 141/417] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:26 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1533 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:27 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5e76dc49-a631-4947-b90e-057a71f75707 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1432 microversion: 2.1 time: 0.244507 Nov 28 14:02:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:26 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1432 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3e50a0-3428-42c7-aee0-baa85761b734", "name": "network-vif-plugged", "status": "completed", "tag": "af80811d-0d53-4367-88e4-0a688c183350"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Creating event network-vif-plugged:af80811d-0d53-4367-88e4-0a688c183350 for instance 2d3e50a0-3428-42c7-aee0-baa85761b734 on user Nov 28 14:02:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038855 Nov 28 14:02:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 140/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-90de5980-57ca-4763-9341-f0e99047c487 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051849 Nov 28 14:02:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 142/420] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:02:28 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:28 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lazy-loading 'services' on Instance uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:02:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments/4dfd2051-f1a1-44d0-967f-cfab350bd0ca" status: 202 len: 0 microversion: 2.1 time: 0.229146 Nov 28 14:02:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 139/421] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:02:28 2023] DELETE /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments/4dfd2051-f1a1-44d0-967f-cfab350bd0ca => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-27bb4315-d352-47f4-a1f1-095da61c440b tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.317946 Nov 28 14:02:29 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:02:28 2023] GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/os-interface => generated 282 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb097930-0134-453a-bf8a-a77dbeabc8fa"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327817 Nov 28 14:02:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 143/423] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:02:29 2023] POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee665431-8646-4683-a0e1-c392d691e7ee", "device": "/dev/vdb"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3e50a0-3428-42c7-aee0-baa85761b734", "name": "network-vif-plugged", "status": "completed", "tag": "af80811d-0d53-4367-88e4-0a688c183350"}, {"name": "network-changed", "server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Creating event network-vif-plugged:af80811d-0d53-4367-88e4-0a688c183350 for instance 2d3e50a0-3428-42c7-aee0-baa85761b734 on user Nov 28 14:02:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Creating event network-changed:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:02:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039140 Nov 28 14:02:30 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 142/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465571 Nov 28 14:02:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 140/425] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:02:30 2023] POST /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c825708b-4362-4ab3-b7ab-f0b254f31500 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1/os-interface" status: 200 len: 296 microversion: 2.93 time: 0.234188 Nov 28 14:02:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 144/426] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 14:02:30 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1/os-interface => generated 296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Creating event network-changed:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:02:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048758 Nov 28 14:02:32 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 141/427] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:32 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3b9ca5b0-7d09-4b9f-b737-dbe3d4e95632 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1723 microversion: 2.93 time: 0.493117 Nov 28 14:02:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 143/428] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:02:32 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-1664826618", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting quotas for project cbf581e03a6c4f678536c9d64fe4b8cc. Resources: dict_keys(['metadata_items']) {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting quotas for user 1406382a40d841b5a59d791ec6744fc4 and project cbf581e03a6c4f678536c9d64fe4b8cc. Resources: dict_keys(['metadata_items']) {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:33 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1/action" status: 202 len: 2047 microversion: 2.93 time: 0.910634 Nov 28 14:02:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 145/429] 10.0.0.210 () {66 vars in 1397 bytes} [Tue Nov 28 14:02:32 2023] POST /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1/action => generated 2047 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 28 14:02:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a40ba1b0-e365-47e0-adf6-6d7d701bda75 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a40ba1b0-e365-47e0-adf6-6d7d701bda75 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.021976 Nov 28 14:02:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 142/430] 10.0.0.210 () {64 vars in 1249 bytes} [Tue Nov 28 14:02:33 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:34 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:34 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:34 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8fd05dec-0063-4517-816b-6b845bbf4690 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1870 microversion: 2.93 time: 0.289311 Nov 28 14:02:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 144/431] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:02:33 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1870 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:02:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Creating event network-vif-unplugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:02:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078842 Nov 28 14:02:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 146/432] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:36 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Creating event network-vif-plugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:02:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Nov 28 14:02:36 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=48 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:45 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-03d5e3ac-596c-4e26-a126-84195a330b3c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1579 microversion: 2.1 time: 0.755598 Nov 28 14:02:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 145/434] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:44 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1579 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=7,nova_cell1:INSERT=5,nova_cell1:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Creating event network-changed:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:02:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111023 Nov 28 14:02:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 147/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:48 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=21 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:48 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:02:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c84d64d3-d744-4c92-aecd-b40981a9b6d9 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-713276970", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "destination_type": "local"}, {"source_type": "volume", "uuid": "16f39d5c-17cb-457b-aaa9-050896424d28", "destination_type": "invalid"}], "networks": [{"uuid": "73322956-2161-4c75-88f6-ddf480017fbe"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c84d64d3-d744-4c92-aecd-b40981a9b6d9 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:02:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c84d64d3-d744-4c92-aecd-b40981a9b6d9 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020273 Nov 28 14:02:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 144/436] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:02:48 2023] POST /compute/v2.1/servers => generated 155 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:48 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-dbc249ac-98fa-4f6d-a6ff-9f9404a3a99e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1492 microversion: 2.1 time: 0.328396 Nov 28 14:02:48 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:48 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1492 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:49 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ee75dddc-cdd6-4ab6-bc4b-8e6ef2999c7c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 200 len: 1545 microversion: 2.1 time: 0.328516 Nov 28 14:02:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:48 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 1545 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-71331e45-6e56-4bef-acb1-02e38626cd72 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'create', calling method: .version_select at 0x7fedf053f250>, body: {"keypair": {"name": "tempest-keypair-1318751346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:49 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-71331e45-6e56-4bef-acb1-02e38626cd72 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:02:49 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-71331e45-6e56-4bef-acb1-02e38626cd72 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:02:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-71331e45-6e56-4bef-acb1-02e38626cd72 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.214669 Nov 28 14:02:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 145/439] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:02:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1210286873"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:50 user devstack@n-api.service[65026]: INFO nova.network.security_group_api [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Adding security group f2c83566-93fd-4253-bcdb-1b86e4f44fb6 to port 43357932-6c86-4dd1-9f8b-22adab7793b9 Nov 28 14:02:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c753d144-c082-442f-9772-3b8b47421855 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/action" status: 202 len: 0 microversion: 2.1 time: 1.073122 Nov 28 14:02:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 147/440] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:02:50 2023] POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/action => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Creating event network-changed:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:02:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029526 Nov 28 14:02:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 146/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3ded08f1-0415-403a-81f4-f2ec1f6dfaef tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1745 microversion: 2.1 time: 0.270983 Nov 28 14:02:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:51 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1745 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-374540379", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "adaa1566-e3ce-4ef9-bb92-0934c59e030e"}], "security_groups": [{"name": "tempest-securitygroup--730247831"}], "key_name": "tempest-keypair-1318751346", "user_data": "}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-7c25febf-aba1-4730-a51f-df1f32b225f2 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044041 Nov 28 14:02:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 147/443] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:02:51 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:02:51 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] validate_networks() for [('adaa1566-e3ce-4ef9-bb92-0934c59e030e', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a1f57dfa-77b4-4b89-9f0e-8821d8e94f5c tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057554 Nov 28 14:02:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 150/444] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:02:51 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:02:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:02:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 204 len: 0 microversion: 2.1 time: 0.286646 Nov 28 14:02:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:02:51 2023] DELETE /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.591771 Nov 28 14:02:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 148/446] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:02:51 2023] POST /compute/v2.1/servers => generated 406 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a99d8a12-9cfc-4cf9-a91b-62b5d34e10b3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a99d8a12-9cfc-4cf9-a91b-62b5d34e10b3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:52 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-a99d8a12-9cfc-4cf9-a91b-62b5d34e10b3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a99d8a12-9cfc-4cf9-a91b-62b5d34e10b3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1232 microversion: 2.1 time: 0.081826 Nov 28 14:02:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 149/447] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:52 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1232 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:52 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bda47eaf5e34007aacf101594a9a158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b30ed6146c4a7f82b357d83df9e88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7d4ef0df-fbbe-4d0c-8c0e-7d9fb9660420 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 200 len: 1670 microversion: 2.1 time: 0.315002 Nov 28 14:02:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 151/448] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:52 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 1670 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "name": "network-vif-unplugged", "status": "completed", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}, {"server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "name": "network-vif-plugged", "status": "completed", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Creating event network-vif-unplugged:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:02:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Creating event network-vif-plugged:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:02:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.058355 Nov 28 14:02:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 149/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:53 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d", "name": "network-vif-deleted", "tag": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] Creating event network-vif-deleted:e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d on user Nov 28 14:02:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028200 Nov 28 14:02:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 150/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Creating event network-changed:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:02:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029815 Nov 28 14:02:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 150/451] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:55 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-948dd3ed-9014-403f-b1e2-0310d1e70448 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1703 microversion: 2.1 time: 0.267658 Nov 28 14:02:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:55 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1703 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:56 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1c55c8bb-cd04-4a36-927c-64b95cf7ed9c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1703 microversion: 2.1 time: 0.214965 Nov 28 14:02:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 151/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:55 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1703 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "tag": "0bbc90b3-d676-465d-8b27-6af2a82d5055"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Creating event volume-reimaged:0bbc90b3-d676-465d-8b27-6af2a82d5055 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:02:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.111129 Nov 28 14:02:57 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 151/454] 10.0.0.210 () {70 vars in 1437 bytes} [Tue Nov 28 14:02:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:02:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "name": "network-vif-plugged", "status": "completed", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Creating event network-vif-plugged:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:02:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042372 Nov 28 14:02:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 153/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/action" status: 202 len: 0 microversion: 2.1 time: 0.117646 Nov 28 14:02:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 152/456] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:02:58 2023] POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:58 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:02:58 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4cfe09bf-a274-4f39-b7dd-dfea454b07af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1747 microversion: 2.1 time: 0.303185 Nov 28 14:02:58 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:02:58 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1747 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:02:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-unplugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:02:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Creating event network-vif-unplugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:02:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054451 Nov 28 14:02:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 154/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:03:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "name": "network-vif-plugged", "status": "completed", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Creating event network-vif-plugged:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:03:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036511 Nov 28 14:03:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 153/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:01 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'services' on Instance uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-plugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Creating event network-vif-plugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:03:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031227 Nov 28 14:03:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 155/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/os-volume_attachments/ee665431-8646-4683-a0e1-c392d691e7ee" status: 202 len: 0 microversion: 2.1 time: 0.224790 Nov 28 14:03:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 153/461] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:03:01 2023] DELETE /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/os-volume_attachments/ee665431-8646-4683-a0e1-c392d691e7ee => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:01 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:03:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" status: 204 len: 0 microversion: 2.1 time: 0.132865 Nov 28 14:03:01 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 154/462] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:03:01 2023] DELETE /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:02 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-52db51cc-b5e6-4b52-879e-9430202e589d tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" status: 200 len: 1711 microversion: 2.1 time: 0.274864 Nov 28 14:03:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 156/463] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:01 2023] GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 => generated 1711 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:04 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:04 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-plugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Creating event network-vif-plugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:03:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Nov 28 14:03:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 154/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-plugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Creating event network-vif-plugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:03:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029635 Nov 28 14:03:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 155/465] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Creating event network-vif-plugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:03:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063070 Nov 28 14:03:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 157/466] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Creating event network-vif-plugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:03:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Nov 28 14:03:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 155/467] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:13 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e0ee68948479fa09697af3cf24b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cec039db477464e97d27271375d7787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c472dfdc-5bb6-4c60-ae28-189b600aa522 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 200 len: 1489 microversion: 2.1 time: 0.269209 Nov 28 14:03:13 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 156/468] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:13 2023] GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 1489 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Going to try to start instance {{(pid=65027) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 14:03:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action" status: 202 len: 0 microversion: 2.1 time: 0.068551 Nov 28 14:03:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 158/469] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:03:17 2023] POST /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/action => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:17 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-398643e1-639d-4919-9096-2fc5ae6901df tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1649 microversion: 2.1 time: 0.209002 Nov 28 14:03:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 156/470] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:17 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1649 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:03:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041873 Nov 28 14:03:20 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 157/471] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:03:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031996 Nov 28 14:03:22 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 159/472] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "name": "network-vif-unplugged", "status": "completed", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Creating event network-vif-unplugged:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:03:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037947 Nov 28 14:03:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 158/473] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:24 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-b03cba12-6e2a-4848-aec4-154797d60e0c tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1861 microversion: 2.93 time: 0.337829 Nov 28 14:03:24 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 157/474] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:03:24 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1861 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:03:25 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "name": "network-vif-deleted", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] Creating event network-vif-deleted:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:03:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056428 Nov 28 14:03:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 160/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1", "name": "network-vif-plugged", "status": "completed", "tag": "c559881f-688d-4805-972f-470ba7cb0c3a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Creating event network-vif-plugged:c559881f-688d-4805-972f-470ba7cb0c3a for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 on user Nov 28 14:03:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031244 Nov 28 14:03:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 159/476] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:27 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d4f293c0-5697-4195-9f1a-dda5ad6ecc57 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1432 microversion: 2.1 time: 0.210740 Nov 28 14:03:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 158/477] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:27 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1432 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Creating event network-changed:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:03:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040021 Nov 28 14:03:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 161/478] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:30 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'flavor' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:03:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a/action" status: 202 len: 0 microversion: 2.1 time: 0.198882 Nov 28 14:03:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 160/479] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:03:30 2023] POST /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:31 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3b8b6f55-634a-4592-b30e-5ae99074de73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1556 microversion: 2.1 time: 0.264327 Nov 28 14:03:31 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 159/480] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:30 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:31 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-unplugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:31 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Creating event network-vif-unplugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:03:31 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073324 Nov 28 14:03:31 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 162/481] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Creating event network-changed:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:03:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045493 Nov 28 14:03:32 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 161/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-plugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Creating event network-vif-plugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:03:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033533 Nov 28 14:03:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 160/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=32 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:42 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] HTTP exception thrown: Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d could not be found. Nov 28 14:03:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Returning 404 to user: Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:03:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-3f4a68e3-d753-4e71-b007-f04cbce2c5c3 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 404 len: 111 microversion: 2.1 time: 0.028575 Nov 28 14:03:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 162/484] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:42 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:03:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-79a0860b-6794-490a-b1b1-0dc2c9b30cd2 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1540 microversion: 2.1 time: 0.218787 Nov 28 14:03:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 163/485] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:42 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1540 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3305eb9d-ccfe-476a-89bf-01b6882fc1b5 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '.version_select at 0x7fedf06acf70>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3305eb9d-ccfe-476a-89bf-01b6882fc1b5 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601378316" status: 202 len: 0 microversion: 2.1 time: 0.025401 Nov 28 14:03:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 161/486] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:03:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601378316 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] HTTP exception thrown: Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d could not be found. Nov 28 14:03:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Returning 404 to user: Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:03:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-eea75b24-491a-40ac-b636-fe4dcaa9756a tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 404 len: 111 microversion: 2.1 time: 0.026452 Nov 28 14:03:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 163/487] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:03:46 2023] DELETE /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] HTTP exception thrown: Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d could not be found. Nov 28 14:03:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Returning 404 to user: Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:03:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-127c5e34-061c-418c-a4e6-555517d28635 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" status: 404 len: 111 microversion: 2.1 time: 0.033998 Nov 28 14:03:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 164/488] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:46 2023] GET /compute/v2.1/servers/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d48415ce-4409-41c8-bf72-45260a3cb361 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.215256 Nov 28 14:03:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 164/489] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:03:49 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-interface => generated 283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:49 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-cef32018-8fe0-4e26-867d-1ac7f5022cd3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1745 microversion: 2.1 time: 0.409660 Nov 28 14:03:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 162/490] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:48 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1745 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa772d7-ca30-4a90-b326-3450f9e28784", "tag": "d38482f3-db24-4172-a831-de471ef45c2b"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Creating event network-changed:d38482f3-db24-4172-a831-de471ef45c2b for instance 3aa772d7-ca30-4a90-b326-3450f9e28784 on user Nov 28 14:03:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031546 Nov 28 14:03:50 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 165/491] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:03:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f13fcc3a-622e-4d48-b8cf-aa9197171678 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/ips" status: 200 len: 109 microversion: 2.1 time: 0.052898 Nov 28 14:03:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 165/492] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 14:03:50 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/ips => generated 109 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] HTTP exception thrown: Instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 could not be found. Nov 28 14:03:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Returning 404 to user: Instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:03:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1ca2ed57-d6e5-404b-b870-bb558499e2da tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" status: 404 len: 111 microversion: 2.1 time: 0.032448 Nov 28 14:03:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 163/493] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:52 2023] GET /compute/v2.1/servers/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:03:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9c94e343-7c04-4cd4-ad69-2666c7e93dda tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Calling method '.version_select at 0x7fedf0479240>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9c94e343-7c04-4cd4-ad69-2666c7e93dda tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89595986" status: 202 len: 0 microversion: 2.1 time: 0.026307 Nov 28 14:03:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 166/494] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 28 14:03:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89595986 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b014d0c-d9b1-480f-b41e-ddcd60515bef"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:53 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439619 Nov 28 14:03:53 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 166/495] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:03:52 2023] POST /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] HTTP exception thrown: Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b could not be found. Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Returning 404 to user: Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:03:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-69a86f02-e1f3-4bf9-a647-7cce18f57d58 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 404 len: 111 microversion: 2.1 time: 0.032954 Nov 28 14:03:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 164/496] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:03:55 2023] DELETE /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] HTTP exception thrown: Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b could not be found. Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Returning 404 to user: Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:03:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c61530db-21f2-4bd4-b63c-73fabcdddc5c tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" status: 404 len: 111 microversion: 2.1 time: 0.033652 Nov 28 14:03:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 167/497] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:55 2023] GET /compute/v2.1/servers/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:03:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 204 len: 0 microversion: 2.1 time: 0.130307 Nov 28 14:03:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 167/498] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:03:55 2023] DELETE /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd0221-4935-4ee2-9958-90a748fe5255", "name": "network-vif-unplugged", "status": "completed", "tag": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Creating event network-vif-unplugged:ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance 48dd0221-4935-4ee2-9958-90a748fe5255 on user Nov 28 14:03:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039559 Nov 28 14:03:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 168/499] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0e7e809b-ec6d-463d-97f1-b6fbdf7f102b tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 200 len: 1498 microversion: 2.1 time: 0.423621 Nov 28 14:03:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 165/500] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:55 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 1498 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:56 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:03:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 204 len: 0 microversion: 2.1 time: 0.221642 Nov 28 14:03:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 168/501] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:03:56 2023] DELETE /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:56 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:03:56 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b7bba971-7ef0-4bf2-9407-458a48d478fa tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 200 len: 1709 microversion: 2.1 time: 0.291077 Nov 28 14:03:56 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 169/502] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:03:56 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 1709 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:03:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-unplugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Creating event network-vif-unplugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:03:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069266 Nov 28 14:03:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 166/503] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:57 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd0221-4935-4ee2-9958-90a748fe5255", "name": "network-vif-plugged", "status": "completed", "tag": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f"}, {"server_uuid": "48dd0221-4935-4ee2-9958-90a748fe5255", "name": "network-vif-deleted", "tag": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Creating event network-vif-plugged:ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance 48dd0221-4935-4ee2-9958-90a748fe5255 on user Nov 28 14:03:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Creating event network-vif-deleted:ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance 48dd0221-4935-4ee2-9958-90a748fe5255 on user Nov 28 14:03:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034275 Nov 28 14:03:57 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 169/504] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-plugged", "status": "completed", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Creating event network-vif-plugged:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:03:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034369 Nov 28 14:03:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 170/505] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:03:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a32cb51-7b87-4d9b-9e94-72cb60f4371f", "name": "network-vif-deleted", "tag": "36d6817d-5a86-4e22-90cd-adfe2b3f176e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:03:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:03:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:03:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:03:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] Creating event network-vif-deleted:36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f on user Nov 28 14:03:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040354 Nov 28 14:03:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 167/506] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-441434432", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "3bfd3351-2c37-456a-b7b8-e306bd80afb4"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] validate_networks() for [('3bfd3351-2c37-456a-b7b8-e306bd80afb4', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for user f88c92554f0f44b0be661aa40aec8670 and project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:04:02 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:04:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.772970 Nov 28 14:04:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 170/507] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:04:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:04:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b963fc91-6710-4648-9f6a-7cb255a9b47b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:02 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b963fc91-6710-4648-9f6a-7cb255a9b47b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:02 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b963fc91-6710-4648-9f6a-7cb255a9b47b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:03 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b963fc91-6710-4648-9f6a-7cb255a9b47b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:03 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b963fc91-6710-4648-9f6a-7cb255a9b47b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b963fc91-6710-4648-9f6a-7cb255a9b47b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9" status: 200 len: 1394 microversion: 2.87 time: 0.114489 Nov 28 14:04:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 171/508] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:04:02 2023] GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9 => generated 1394 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b014d0c-d9b1-480f-b41e-ddcd60515bef"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Invalid volume: volume 2b014d0c-d9b1-480f-b41e-ddcd60515bef is already attached to instances: 3aa772d7-ca30-4a90-b326-3450f9e28784 Nov 28 14:04:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 400 to user: Invalid volume: volume 2b014d0c-d9b1-480f-b41e-ddcd60515bef is already attached to instances: 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:04:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-217d03f7-3710-4bcb-a549-6f398155dcc2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.177830 Nov 28 14:04:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 168/509] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:04:04 2023] POST /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments => generated 174 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:04 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'services' on Instance uuid 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:04:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments/2b014d0c-d9b1-480f-b41e-ddcd60515bef" status: 202 len: 0 microversion: 2.1 time: 0.164995 Nov 28 14:04:04 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 171/510] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:04:04 2023] DELETE /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments/2b014d0c-d9b1-480f-b41e-ddcd60515bef => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1fb2fe90-b3c6-4620-9383-82fc2d98518a tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065489 Nov 28 14:04:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 172/511] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:04:04 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839b0b0f-101d-46ca-97a8-ab404cc35ea9", "tag": "51520e6e-9061-4b7f-8860-53b7cfa9028a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Creating event network-changed:51520e6e-9061-4b7f-8860-53b7cfa9028a for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 on user Nov 28 14:04:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032559 Nov 28 14:04:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 169/512] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:07 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-071b4b92-01f3-4b24-965f-54d7a1e0553b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1653 microversion: 2.1 time: 0.240228 Nov 28 14:04:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 172/513] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:07 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1653 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:04:07 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839b0b0f-101d-46ca-97a8-ab404cc35ea9", "name": "network-vif-plugged", "status": "completed", "tag": "51520e6e-9061-4b7f-8860-53b7cfa9028a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Creating event network-vif-plugged:51520e6e-9061-4b7f-8860-53b7cfa9028a for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 on user Nov 28 14:04:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035362 Nov 28 14:04:07 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 173/514] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839b0b0f-101d-46ca-97a8-ab404cc35ea9", "name": "network-vif-plugged", "status": "completed", "tag": "51520e6e-9061-4b7f-8860-53b7cfa9028a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Creating event network-vif-plugged:51520e6e-9061-4b7f-8860-53b7cfa9028a for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 on user Nov 28 14:04:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Nov 28 14:04:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 170/515] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41f6f108-0e4f-45c9-9f7a-960844609545"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312367 Nov 28 14:04:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 173/516] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:04:16 2023] POST /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=30 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:21 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-dacdfcd8-f76a-4e54-8d3a-e6b4572cc71c tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1497 microversion: 2.1 time: 0.257398 Nov 28 14:04:21 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 174/517] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:21 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=17 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=30 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:24 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:24 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-b06ba88c-4d96-44bb-b2fb-410e659605f6 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1861 microversion: 2.93 time: 0.235252 Nov 28 14:04:24 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 171/518] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:04:24 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1861 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:04:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 204 len: 0 microversion: 2.93 time: 0.220331 Nov 28 14:04:25 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 174/519] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:04:25 2023] DELETE /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:25 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-6f59a377-c2ee-400f-ad7e-061daed2e471 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 200 len: 1867 microversion: 2.93 time: 0.305586 Nov 28 14:04:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 175/520] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:04:25 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 1867 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:04:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Creating event network-vif-unplugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:04:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047138 Nov 28 14:04:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 172/521] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:04:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 204 len: 0 microversion: 2.1 time: 0.126590 Nov 28 14:04:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 175/522] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:04:26 2023] DELETE /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:26 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e0ee68948479fa09697af3cf24b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cec039db477464e97d27271375d7787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9cc5f3a7-1d3f-40d7-bc81-e2592364124a tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 200 len: 1541 microversion: 2.1 time: 0.293241 Nov 28 14:04:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 176/523] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:26 2023] GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 1541 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:04:26 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3e50a0-3428-42c7-aee0-baa85761b734", "name": "network-vif-unplugged", "status": "completed", "tag": "af80811d-0d53-4367-88e4-0a688c183350"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Creating event network-vif-unplugged:af80811d-0d53-4367-88e4-0a688c183350 for instance 2d3e50a0-3428-42c7-aee0-baa85761b734 on user Nov 28 14:04:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031142 Nov 28 14:04:26 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 173/524] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:27 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}, {"server_uuid": "6466bc94-8a78-4541-a864-9f0370b212c1", "name": "network-vif-deleted", "tag": "f85d8e95-0038-4312-bfc1-28b0a2354a09"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Creating event network-vif-plugged:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:04:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Creating event network-vif-deleted:f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance 6466bc94-8a78-4541-a864-9f0370b212c1 on user Nov 28 14:04:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035736 Nov 28 14:04:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 176/525] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3e50a0-3428-42c7-aee0-baa85761b734", "name": "network-vif-plugged", "status": "completed", "tag": "af80811d-0d53-4367-88e4-0a688c183350"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Creating event network-vif-plugged:af80811d-0d53-4367-88e4-0a688c183350 for instance 2d3e50a0-3428-42c7-aee0-baa85761b734 on user Nov 28 14:04:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054503 Nov 28 14:04:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 177/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:29 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3e50a0-3428-42c7-aee0-baa85761b734", "name": "network-vif-deleted", "tag": "af80811d-0d53-4367-88e4-0a688c183350"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] Creating event network-vif-deleted:af80811d-0d53-4367-88e4-0a688c183350 for instance 2d3e50a0-3428-42c7-aee0-baa85761b734 on user Nov 28 14:04:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046163 Nov 28 14:04:29 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 174/527] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=106,nova_cell1:UPDATE=12,nova_cell1:INSERT=7 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f0965775-9926-4c36-a9b8-407ce1cb9296 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.212254 Nov 28 14:04:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 177/528] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:04:42 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382/os-interface => generated 282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=20 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:43 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Creating event network-changed:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:04:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052375 Nov 28 14:04:43 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 178/529] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=12 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:44 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d9426cbb-7c8d-473f-8c0b-bae523e83b46 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1540 microversion: 2.1 time: 0.187332 Nov 28 14:04:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 175/530] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:44 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1540 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:44 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-137e6322-b685-4253-915e-e7c8f68cbc38 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1540 microversion: 2.1 time: 0.194731 Nov 28 14:04:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 178/531] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:44 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1540 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:04:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:45 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] HTTP exception thrown: Instance 48dd0221-4935-4ee2-9958-90a748fe5255 could not be found. Nov 28 14:04:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Returning 404 to user: Instance 48dd0221-4935-4ee2-9958-90a748fe5255 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:04:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e5fe34b9-ce88-4256-9ef6-ae02881d8fa3 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255" status: 404 len: 111 microversion: 2.1 time: 0.033671 Nov 28 14:04:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 179/532] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:45 2023] GET /compute/v2.1/servers/48dd0221-4935-4ee2-9958-90a748fe5255 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HTTP exception thrown: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. Nov 28 14:04:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Returning 404 to user: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:04:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ccd00de3-d039-4fa0-944a-ae0b03ffabdd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 404 len: 111 microversion: 2.1 time: 0.028493 Nov 28 14:04:46 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 176/533] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:46 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HTTP exception thrown: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. Nov 28 14:04:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Returning 404 to user: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:04:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4c2b9a48-0170-4729-8ca3-0efeb948eb55 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033934 Nov 28 14:04:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 179/534] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:04:46 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1210286873"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:50 user devstack@n-api.service[65027]: INFO nova.network.security_group_api [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Removing security group f2c83566-93fd-4253-bcdb-1b86e4f44fb6 from port 43357932-6c86-4dd1-9f8b-22adab7793b9 Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HTTP exception thrown: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Returning 404 to user: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:04:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ae192399-8432-4a7b-90f1-ed5985adfd66 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 404 len: 111 microversion: 2.1 time: 0.034210 Nov 28 14:04:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 177/535] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:04:51 2023] DELETE /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HTTP exception thrown: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Returning 404 to user: Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:04:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-21d7b37e-91b0-49b4-a676-e4a9bad58be2 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f" status: 404 len: 111 microversion: 2.1 time: 0.036832 Nov 28 14:04:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 180/536] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:51 2023] GET /compute/v2.1/servers/9a32cb51-7b87-4d9b-9e94-72cb60f4371f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:04:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3b54b5e7-01be-4cf1-a75c-1bdf83c0e5fd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Calling method '.version_select at 0x7fedf08ea9e0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3b54b5e7-01be-4cf1-a75c-1bdf83c0e5fd tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095208703" status: 202 len: 0 microversion: 2.1 time: 0.032088 Nov 28 14:04:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 178/537] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:04:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095208703 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:04:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3d2e192e-137c-48af-9062-ce562ea4639d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/action" status: 202 len: 0 microversion: 2.1 time: 1.283000 Nov 28 14:04:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 180/538] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:04:50 2023] POST /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/action => generated 0 bytes in 1285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Creating event network-changed:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:04:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 Nov 28 14:04:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 181/539] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:52 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'services' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:04:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments/cb097930-0134-453a-bf8a-a77dbeabc8fa" status: 202 len: 0 microversion: 2.1 time: 0.230151 Nov 28 14:04:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 179/540] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:04:52 2023] DELETE /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments/cb097930-0134-453a-bf8a-a77dbeabc8fa => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:53 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-86bf5e8b-ab58-48f6-893b-c06abb2466f3 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144700 Nov 28 14:04:53 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 181/541] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:04:53 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:53 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:53 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-7ec1f5d3-31c7-4603-9624-8e47ea4a4e96 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9" status: 200 len: 1690 microversion: 2.87 time: 0.386095 Nov 28 14:04:53 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 182/542] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:04:53 2023] GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9 => generated 1690 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:04:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Creating event network-changed:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:04:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038113 Nov 28 14:04:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 180/543] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-41fbe0c0-6996-4494-abdc-462597447985 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048989 Nov 28 14:04:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 182/544] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:04:54 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:54 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:04:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 204 len: 0 microversion: 2.1 time: 0.470099 Nov 28 14:04:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 183/545] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:04:54 2023] DELETE /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:04:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-268da281-fbcf-4df9-bfac-a93268b50dca tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 200 len: 1669 microversion: 2.1 time: 0.474321 Nov 28 14:04:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 181/546] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:04:55 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 1669 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:04:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa772d7-ca30-4a90-b326-3450f9e28784", "name": "network-vif-deleted", "tag": "d38482f3-db24-4172-a831-de471ef45c2b"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:04:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:04:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:04:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] Creating event network-vif-deleted:d38482f3-db24-4172-a831-de471ef45c2b for instance 3aa772d7-ca30-4a90-b326-3450f9e28784 on user Nov 28 14:04:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057058 Nov 28 14:04:57 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 183/547] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:04:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:04:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ec4ec955-7596-42a4-92f9-f2000fb9dae5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'create', calling method: .version_select at 0x7fedf0415120>, body: {"keypair": {"name": "tempest-keypair-1276374203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRx1CaHhz7T4iWZHcZU/u7mxv1qFYSTYPVbEd+1AG15eK9htz2w/1zgpgePgXRBe/1I2oHV07JSN71mZsmDsoUxJkz8utVlRxN75p5/8zRBkg+ecBdhPIs3fNz9MW2gDA=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:04:58 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-ec4ec955-7596-42a4-92f9-f2000fb9dae5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:04:58 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-ec4ec955-7596-42a4-92f9-f2000fb9dae5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for user e8074110936b461690a6518ddee180ac and project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:04:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ec4ec955-7596-42a4-92f9-f2000fb9dae5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.165280 Nov 28 14:04:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 184/548] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 14:04:58 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822996976", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "97080b5a-fd19-4a16-bc96-21d386fe3782"}], "security_groups": [{"name": "tempest-securitygroup--740349904"}], "key_name": "tempest-keypair-1276374203", "user_data": "}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] validate_networks() for [('97080b5a-fd19-4a16-bc96-21d386fe3782', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for user e8074110936b461690a6518ddee180ac and project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:05:00 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:05:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.620144 Nov 28 14:05:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 182/549] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:05:00 2023] POST /compute/v2.1/servers => generated 399 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:05:00 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-98b253ed-71c6-46df-b90c-c7bb10b8b12b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:01 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-98b253ed-71c6-46df-b90c-c7bb10b8b12b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:01 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-98b253ed-71c6-46df-b90c-c7bb10b8b12b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:01 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-98b253ed-71c6-46df-b90c-c7bb10b8b12b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:01 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-98b253ed-71c6-46df-b90c-c7bb10b8b12b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-98b253ed-71c6-46df-b90c-c7bb10b8b12b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1273 microversion: 2.20 time: 0.090120 Nov 28 14:05:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 184/550] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:05:00 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:05:03 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Creating event network-changed:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:05:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040753 Nov 28 14:05:03 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 185/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-plugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Creating event network-vif-plugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:05:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055149 Nov 28 14:05:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 183/552] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:07 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-plugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Creating event network-vif-plugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:05:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042416 Nov 28 14:05:07 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 185/553] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5d62d24e-ba2f-49be-a653-d7ba116c95da tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046753 Nov 28 14:05:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 186/554] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:05:08 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:08 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:05:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 204 len: 0 microversion: 2.1 time: 0.203691 Nov 28 14:05:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 184/555] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:05:08 2023] DELETE /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-unplugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Creating event network-vif-unplugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:05:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037877 Nov 28 14:05:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 187/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:09 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0cc3d603-3ea8-4f2d-8ac7-cc474e07cd9a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 200 len: 1659 microversion: 2.1 time: 0.610342 Nov 28 14:05:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 186/557] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:08 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 1659 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:10 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-deleted", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] Creating event network-vif-deleted:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:05:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042090 Nov 28 14:05:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 185/558] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e135e2-a52b-437c-adb6-3fb81daf17e4", "name": "network-vif-plugged", "status": "completed", "tag": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Creating event network-vif-plugged:56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 on user Nov 28 14:05:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035967 Nov 28 14:05:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 188/559] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] HTTP exception thrown: Instance 6466bc94-8a78-4541-a864-9f0370b212c1 could not be found. Nov 28 14:05:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Returning 404 to user: Instance 6466bc94-8a78-4541-a864-9f0370b212c1 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-bbc83d23-1f4f-48db-a8cf-c2c7c04b3327 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1" status: 404 len: 111 microversion: 2.93 time: 0.031094 Nov 28 14:05:15 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 187/560] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:05:15 2023] GET /compute/v2.1/servers/6466bc94-8a78-4541-a864-9f0370b212c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:05:15 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:15 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:15 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-632624f5-c96d-4cb0-b764-5a2adfe9d1c4 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Calling method '.version_select at 0x7fedf0419900>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:15 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-632624f5-c96d-4cb0-b764-5a2adfe9d1c4 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958037787" status: 204 len: 0 microversion: 2.93 time: 0.038668 Nov 28 14:05:15 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 186/561] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 14:05:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958037787 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] HTTP exception thrown: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. Nov 28 14:05:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Returning 404 to user: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a1791850-b105-4d1f-8b19-96a657b38b87 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 404 len: 111 microversion: 2.1 time: 0.028180 Nov 28 14:05:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 189/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:16 2023] GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] HTTP exception thrown: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. Nov 28 14:05:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Returning 404 to user: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b4a3be04-4df7-4615-a9c6-c4e025baf7cd tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030087 Nov 28 14:05:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 188/563] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:05:17 2023] GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] HTTP exception thrown: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. Nov 28 14:05:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Returning 404 to user: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8a8b78a5-8bb1-4752-8c35-c7b798bf1150 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 404 len: 111 microversion: 2.1 time: 0.030372 Nov 28 14:05:20 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 187/564] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:05:20 2023] DELETE /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] HTTP exception thrown: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. Nov 28 14:05:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Returning 404 to user: Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e0eefda7-f5e2-413b-a3ca-7dd9941307b2 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734" status: 404 len: 111 microversion: 2.1 time: 0.030489 Nov 28 14:05:20 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 190/565] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:20 2023] GET /compute/v2.1/servers/2d3e50a0-3428-42c7-aee0-baa85761b734 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:21 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65027) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 14:05:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a/action" status: 202 len: 0 microversion: 2.1 time: 0.382435 Nov 28 14:05:21 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 189/566] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:05:21 2023] POST /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:22 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0b83067b-3d83-4edc-8f74-d44f3e98cf41 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1505 microversion: 2.1 time: 0.433356 Nov 28 14:05:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 188/567] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:21 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-10fa2473-42f4-4238-ad52-18927e60d0c0 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf053feb0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-10fa2473-42f4-4238-ad52-18927e60d0c0 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2280b1bc-7ffa-4d66-bdb3-993e85878d54" status: 200 len: 351 microversion: 2.1 time: 0.287587 Nov 28 14:05:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 191/568] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:05:24 2023] GET /compute/v2.1/os-volumes/2280b1bc-7ffa-4d66-bdb3-993e85878d54 => generated 351 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:05:27 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-6a6175ba-f4e8-4657-a17f-c5fb3a418c9f tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf04784c0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:27 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-6a6175ba-f4e8-4657-a17f-c5fb3a418c9f tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/722407aa-4db8-4312-8d70-5230dc58a311" status: 200 len: 351 microversion: 2.1 time: 0.051146 Nov 28 14:05:27 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 190/569] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:05:27 2023] GET /compute/v2.1/os-volumes/722407aa-4db8-4312-8d70-5230dc58a311 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:29 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8677089e-f1af-4941-87af-36732abc8de2 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf06aee60>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8677089e-f1af-4941-87af-36732abc8de2 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/67a3d059-63d5-43e3-88ce-2da57e8f92da" status: 200 len: 351 microversion: 2.1 time: 0.056626 Nov 28 14:05:29 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 189/570] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:05:29 2023] GET /compute/v2.1/os-volumes/67a3d059-63d5-43e3-88ce-2da57e8f92da => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:29 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f51dd8a3-6ad0-4486-aa5a-84ce53271739 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf0645900>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:29 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f51dd8a3-6ad0-4486-aa5a-84ce53271739 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.124322 Nov 28 14:05:29 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 192/571] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 14:05:29 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bd7bb9d3-e125-46f3-9609-c2b0e92004ef tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf04792d0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-bd7bb9d3-e125-46f3-9609-c2b0e92004ef tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.146557 Nov 28 14:05:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 191/572] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Nov 28 14:05:29 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5b776171-3edc-4cef-8f70-b89852df2e08 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf06adbd0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5b776171-3edc-4cef-8f70-b89852df2e08 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.135784 Nov 28 14:05:30 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 190/573] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 14:05:30 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6b9c9e60-167e-4332-8897-8c0cc22697bd tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf053feb0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6b9c9e60-167e-4332-8897-8c0cc22697bd tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.145344 Nov 28 14:05:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 193/574] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Nov 28 14:05:30 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:30 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1337d45e-b72d-43ae-9050-5444f58dda4d tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf047bd90>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1337d45e-b72d-43ae-9050-5444f58dda4d tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.145768 Nov 28 14:05:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 192/575] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Nov 28 14:05:30 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-fdf722ea-6926-4bdd-a246-c38271148fbc tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf06af760>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-fdf722ea-6926-4bdd-a246-c38271148fbc tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.187905 Nov 28 14:05:30 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 191/576] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 14:05:30 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:05:30 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:30 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-44c47d15-882f-4dcc-93c3-da2b042f16fd tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf0415a20>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-44c47d15-882f-4dcc-93c3-da2b042f16fd tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.179383 Nov 28 14:05:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 194/577] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Nov 28 14:05:30 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:31 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8d0c91b6-2255-438d-bf28-876153d5ce61 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] Calling method '.version_select at 0x7fedf0582d40>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:31 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8d0c91b6-2255-438d-bf28-876153d5ce61 tempest-VolumesTestJSON-949543866 tempest-VolumesTestJSON-949543866-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.153008 Nov 28 14:05:31 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 193/578] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 14:05:31 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Creating event network-changed:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:05:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194850 Nov 28 14:05:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 192/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:34 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:34 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5630b803-4031-44bc-9735-1eeb558df624 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1659 microversion: 2.1 time: 0.214864 Nov 28 14:05:34 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 195/580] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:34 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1659 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:35 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0ae55fa1-07e0-4558-8380-3e45fb93ebec tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1659 microversion: 2.1 time: 0.274537 Nov 28 14:05:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 194/581] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:34 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1659 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-plugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Creating event network-vif-plugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:05:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037137 Nov 28 14:05:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 193/582] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-plugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Creating event network-vif-plugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:05:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039656 Nov 28 14:05:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 196/583] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-104d7792-299d-4a2c-9541-9ae1b524e8a0 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.287203 Nov 28 14:05:43 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 195/584] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:05:43 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments => generated 25 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] HTTP exception thrown: Instance ea32aeb2-975a-4295-aeb6-12e177657219 is not attached to volume cb097930-0134-453a-bf8a-a77dbeabc8fa Nov 28 14:05:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Returning 404 to user: Instance ea32aeb2-975a-4295-aeb6-12e177657219 is not attached to volume cb097930-0134-453a-bf8a-a77dbeabc8fa {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-48e86f3c-f418-43b4-8772-687ae3fdf70c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments/cb097930-0134-453a-bf8a-a77dbeabc8fa" status: 404 len: 154 microversion: 2.1 time: 0.120321 Nov 28 14:05:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 194/585] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:05:43 2023] DELETE /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219/os-volume_attachments/cb097930-0134-453a-bf8a-a77dbeabc8fa => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 could not be found. Nov 28 14:05:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-80b2d58b-d585-4a83-8f82-0916cdd5613e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 404 len: 111 microversion: 2.1 time: 0.454487 Nov 28 14:05:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 197/586] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:45 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 111 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:05:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c461d442-210b-431b-b8d3-ca2f037a1bbe tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '.version_select at 0x7fedf06d2200>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c461d442-210b-431b-b8d3-ca2f037a1bbe tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356044097" status: 202 len: 0 microversion: 2.1 time: 0.025968 Nov 28 14:05:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 196/587] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:05:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356044097 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:05:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e46003cd-ff71-4212-b39f-b435cc12ec6e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: .version_select at 0x7fedf08eb880>, body: {"keypair": {"name": "tempest-keypair-464159864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXDMolo6w7qSOXv1l6Avbf9K2hLPR2zVqVxwo4QijsQzb2s+d8Sb/i5JGKrR68loytXMx+JqlFbWuJ3sNpIxhX0BWXkTOmK/gfwSkeBfCHv9PyJdB1VxE/hnfjZJS8v0Q=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:47 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-e46003cd-ff71-4212-b39f-b435cc12ec6e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:05:47 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-e46003cd-ff71-4212-b39f-b435cc12ec6e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:05:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e46003cd-ff71-4212-b39f-b435cc12ec6e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083090 Nov 28 14:05:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 195/588] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:05:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:48 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:05:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 204 len: 0 microversion: 2.1 time: 0.281403 Nov 28 14:05:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 198/589] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:05:48 2023] DELETE /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:49 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-unplugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-12895dd8-5298-4800-a022-bf1d8a0a791d tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 200 len: 1539 microversion: 2.1 time: 0.567193 Nov 28 14:05:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 197/590] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:48 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 1539 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Creating event network-vif-unplugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:05:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078531 Nov 28 14:05:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 199/591] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-732089374", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "6ab99829-a69e-4d03-a12d-572a7d42564a"}]}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:49 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] validate_networks() for [('6ab99829-a69e-4d03-a12d-572a7d42564a', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Getting quotas for project 70e6f2f181214fa494ee8b5ca7eaad86. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Getting quotas for user 02461b60e13a4db999369d87c2e426e8 and project 70e6f2f181214fa494ee8b5ca7eaad86. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:05:50 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1001588883", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7"}], "security_groups": [{"name": "tempest-securitygroup--1175272386"}], "key_name": "tempest-keypair-464159864", "user_data": "}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:50 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.346799 Nov 28 14:05:50 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 196/592] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:05:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:05:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8da09dd7-af35-4422-ba63-a156898cb370 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:50 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8da09dd7-af35-4422-ba63-a156898cb370 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:50 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8da09dd7-af35-4422-ba63-a156898cb370 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02461b60e13a4db999369d87c2e426e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e6f2f181214fa494ee8b5ca7eaad86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8da09dd7-af35-4422-ba63-a156898cb370 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91" status: 200 len: 1205 microversion: 2.1 time: 0.075561 Nov 28 14:05:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 200/593] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:50 2023] GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91 => generated 1205 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] validate_networks() for [('eb697d01-87f7-4768-84bb-0e25fdf0c3e7', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:50 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting quotas for user 2afdefdd832241779d405f4763c3b37e and project b710669f2d5c41378e2c63765f2846ed. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:05:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.798176 Nov 28 14:05:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 198/594] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:05:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:05:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-plugged", "status": "completed", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}, {"server_uuid": "ea32aeb2-975a-4295-aeb6-12e177657219", "name": "network-vif-deleted", "tag": "43357932-6c86-4dd1-9f8b-22adab7793b9"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a048ad73-e1a4-43b6-83e9-21ce16970012 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a048ad73-e1a4-43b6-83e9-21ce16970012 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Creating event network-vif-plugged:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:05:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Creating event network-vif-deleted:43357932-6c86-4dd1-9f8b-22adab7793b9 for instance ea32aeb2-975a-4295-aeb6-12e177657219 on user Nov 28 14:05:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037867 Nov 28 14:05:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 197/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:51 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-a048ad73-e1a4-43b6-83e9-21ce16970012 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a048ad73-e1a4-43b6-83e9-21ce16970012 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 200 len: 1233 microversion: 2.1 time: 0.090931 Nov 28 14:05:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 201/596] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:51 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:51 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:05:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8adb0a82-18b1-4d72-a841-c66cfc0d1838 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1583 microversion: 2.20 time: 0.313640 Nov 28 14:05:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 199/597] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:05:51 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1583 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:05:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93312f50-72e0-4d65-a125-e6101ad73c91", "tag": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Creating event network-changed:ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance 93312f50-72e0-4d65-a125-e6101ad73c91 on user Nov 28 14:05:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037563 Nov 28 14:05:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 198/598] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1813887583"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Creating event network-changed:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:05:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197374 Nov 28 14:05:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 200/599] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9/action" status: 202 len: 52 microversion: 2.87 time: 1.235155 Nov 28 14:05:54 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 202/600] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:05:53 2023] POST /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9/action => generated 52 bytes in 1238 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 14:05:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93312f50-72e0-4d65-a125-e6101ad73c91", "name": "network-vif-plugged", "status": "completed", "tag": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Creating event network-vif-plugged:ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance 93312f50-72e0-4d65-a125-e6101ad73c91 on user Nov 28 14:05:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 Nov 28 14:05:57 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 199/601] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "name": "network-vif-plugged", "status": "completed", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Creating event network-vif-plugged:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:05:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034425 Nov 28 14:05:57 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 201/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HTTP exception thrown: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Returning 404 to user: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:05:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ffa26e7c-392e-4dc7-a2e8-3d028333a500 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 404 len: 111 microversion: 2.1 time: 0.029558 Nov 28 14:05:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 203/603] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:05:59 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:05:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-45492493-cb9c-4ab8-ac03-f3c7e46dec8f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '.version_select at 0x7fedf14f31c0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:05:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-45492493-cb9c-4ab8-ac03-f3c7e46dec8f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605550184" status: 202 len: 0 microversion: 2.1 time: 0.023738 Nov 28 14:05:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 200/604] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:05:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605550184 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:05:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93312f50-72e0-4d65-a125-e6101ad73c91", "name": "network-vif-plugged", "status": "completed", "tag": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Creating event network-vif-plugged:ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance 93312f50-72e0-4d65-a125-e6101ad73c91 on user Nov 28 14:05:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049670 Nov 28 14:05:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 202/605] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "name": "network-vif-plugged", "status": "completed", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:05:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:05:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Creating event network-vif-plugged:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:05:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Nov 28 14:05:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 204/606] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-751fae01-4fb2-4432-b1b6-44b6eb87ea61 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: .version_select at 0x7fedf06ac280>, body: {"keypair": {"name": "tempest-keypair-391843838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFlWuxo8d8nXMdcMC+s1idcRUDtykbajPlJfdAc1yg+5uv17LczFuATBa/Zata1knPZjntuig8DVjH54qv+G83AvNVS75hcVNIAFU8NzNT2nYswUpaffMO1Rffqfi5Fxw=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:00 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-751fae01-4fb2-4432-b1b6-44b6eb87ea61 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:00 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-751fae01-4fb2-4432-b1b6-44b6eb87ea61 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for user c38a4b08cd204e2a9b313a7740df3f3e and project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-751fae01-4fb2-4432-b1b6-44b6eb87ea61 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073001 Nov 28 14:06:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 201/607] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:06:00 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:02 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-70bf4862-5ce2-4d1a-8335-895514fcd4c0 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9" status: 200 len: 1690 microversion: 2.87 time: 0.370503 Nov 28 14:06:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 203/608] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:06:02 2023] GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9 => generated 1690 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:06:02 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1436423002", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "44d4bd64-355a-4f2d-a009-466966959f54"}], "security_groups": [{"name": "tempest-securitygroup--977878291"}], "key_name": "tempest-keypair-391843838", "user_data": "}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:03 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] validate_networks() for [('44d4bd64-355a-4f2d-a009-466966959f54', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting quotas for user c38a4b08cd204e2a9b313a7740df3f3e and project 56b5137584864cf094d60d14e6f0ab0f. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:06:04 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:06:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.445306 Nov 28 14:06:04 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 205/609] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:06:02 2023] POST /compute/v2.1/servers => generated 399 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:06:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0ea572af-061a-4ed9-93fa-9f8e70ac753a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:04 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0ea572af-061a-4ed9-93fa-9f8e70ac753a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:04 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0ea572af-061a-4ed9-93fa-9f8e70ac753a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0ea572af-061a-4ed9-93fa-9f8e70ac753a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 200 len: 1229 microversion: 2.1 time: 0.120109 Nov 28 14:06:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 202/610] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:04 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 1229 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:07 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:07 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Creating event network-changed:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:06:07 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Nov 28 14:06:07 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 204/611] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "name": "network-vif-plugged", "status": "completed", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Creating event network-vif-plugged:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:06:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033473 Nov 28 14:06:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 206/612] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "name": "network-vif-plugged", "status": "completed", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:11 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=18 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Creating event network-vif-plugged:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:06:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052993 Nov 28 14:06:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 203/613] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:12 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d1d47275-8824-4b26-8ca6-5929dc7ce6d4 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1550 microversion: 2.1 time: 0.317127 Nov 28 14:06:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 205/614] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:12 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1550 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:06:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-bf9f7223-e470-427e-9fbe-8737f166a9a8 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Action: 'create', calling method: .version_select at 0x7fedf0416f80>, body: {"keypair": {"name": "tempest-keypair-1951635767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlM2hXaV3Pzjaj6/HdedyPOs6vnZt3xznkE5NqteNJ5ty/uea2Qpug6fvXqeAxpNO+mcSDzqo4TKu7ZmhNltk+7KVpKJxd2Pa3kqXStGtiqGOQWQzNfe4hrBobKEC8l4A=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:14 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-bf9f7223-e470-427e-9fbe-8737f166a9a8 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting quotas for project 5c0c4bb4dbc142aeaa4974495fd6f9a5. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:14 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-bf9f7223-e470-427e-9fbe-8737f166a9a8 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting quotas for user c9d2a50791634583ace0b93cb1459256 and project 5c0c4bb4dbc142aeaa4974495fd6f9a5. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-bf9f7223-e470-427e-9fbe-8737f166a9a8 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096925 Nov 28 14:06:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 207/615] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:06:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-2012684965", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "1cdb9e59-4649-491d-b333-8a4aa7e9b358"}], "security_groups": [{"name": "tempest-securitygroup--836017379"}], "key_name": "tempest-keypair-1951635767", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:16 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] validate_networks() for [('1cdb9e59-4649-491d-b333-8a4aa7e9b358', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting quotas for project 5c0c4bb4dbc142aeaa4974495fd6f9a5. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting quotas for user c9d2a50791634583ace0b93cb1459256 and project 5c0c4bb4dbc142aeaa4974495fd6f9a5. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:06:17 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:06:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.791423 Nov 28 14:06:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 204/616] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:06:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:06:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-451750be-4858-415f-9e0a-d8e4d5c27f34 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-451750be-4858-415f-9e0a-d8e4d5c27f34 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:17 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-451750be-4858-415f-9e0a-d8e4d5c27f34 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2a50791634583ace0b93cb1459256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-451750be-4858-415f-9e0a-d8e4d5c27f34 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5" status: 200 len: 1244 microversion: 2.1 time: 0.104990 Nov 28 14:06:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 206/617] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:17 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:19 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:19 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Creating event network-changed:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:06:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036318 Nov 28 14:06:19 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 208/618] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "name": "network-vif-plugged", "status": "completed", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Creating event network-vif-plugged:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:06:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082541 Nov 28 14:06:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 205/619] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:24 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=46 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:24 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "name": "network-vif-plugged", "status": "completed", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:24 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Creating event network-vif-plugged:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:06:24 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037694 Nov 28 14:06:24 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 207/620] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1349513798", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "39e05b38-9721-451b-a6d4-fa95e025bcc2"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] validate_networks() for [('39e05b38-9721-451b-a6d4-fa95e025bcc2', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Getting quotas for project d70602cf7cc04aed9d9f010e82cd37b3. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Getting quotas for user e4918246c1354b6a923ed07fd6136069 and project d70602cf7cc04aed9d9f010e82cd37b3. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:06:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:06:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.631779 Nov 28 14:06:25 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 209/621] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:06:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:06:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-80271ced-3c75-4632-8817-d80b548795ba tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:25 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-80271ced-3c75-4632-8817-d80b548795ba tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:25 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-80271ced-3c75-4632-8817-d80b548795ba tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-80271ced-3c75-4632-8817-d80b548795ba tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f" status: 200 len: 1206 microversion: 2.1 time: 0.068244 Nov 28 14:06:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 206/622] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:25 2023] GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f => generated 1206 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85e0a0a1-9ed0-4f33-8a44-33649338b57f", "tag": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Creating event network-changed:152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f on user Nov 28 14:06:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Nov 28 14:06:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 208/623] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e0a0a1-9ed0-4f33-8a44-33649338b57f", "name": "network-vif-plugged", "status": "completed", "tag": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Creating event network-vif-plugged:152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f on user Nov 28 14:06:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Nov 28 14:06:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 210/624] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e0a0a1-9ed0-4f33-8a44-33649338b57f", "name": "network-vif-plugged", "status": "completed", "tag": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Creating event network-vif-plugged:152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f on user Nov 28 14:06:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044660 Nov 28 14:06:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 207/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:35 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d7999db6-9cdb-49d0-bcbb-304ec287cbe3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'create', calling method: .version_select at 0x7fedf06d0a60>, body: {"keypair": {"name": "tempest-keypair-1093862542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:35 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:35 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d7999db6-9cdb-49d0-bcbb-304ec287cbe3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:35 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d7999db6-9cdb-49d0-bcbb-304ec287cbe3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d7999db6-9cdb-49d0-bcbb-304ec287cbe3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082495 Nov 28 14:06:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 209/626] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:06:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1682840901", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "adaa1566-e3ce-4ef9-bb92-0934c59e030e"}], "security_groups": [{"name": "tempest-securitygroup--1664582468"}], "key_name": "tempest-keypair-1093862542", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] validate_networks() for [('adaa1566-e3ce-4ef9-bb92-0934c59e030e', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:06:37 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:06:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.575623 Nov 28 14:06:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 211/627] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:06:37 2023] POST /compute/v2.1/servers => generated 404 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:06:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:37 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-848ba7c8-a1f5-4d82-9c7d-fd6f1fccb0f9 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:37 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-848ba7c8-a1f5-4d82-9c7d-fd6f1fccb0f9 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:37 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-848ba7c8-a1f5-4d82-9c7d-fd6f1fccb0f9 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:37 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-848ba7c8-a1f5-4d82-9c7d-fd6f1fccb0f9 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1234 microversion: 2.1 time: 0.078081 Nov 28 14:06:37 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 208/628] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:37 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1234 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:39 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] HTTP exception thrown: Instance ea32aeb2-975a-4295-aeb6-12e177657219 could not be found. Nov 28 14:06:39 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Returning 404 to user: Instance ea32aeb2-975a-4295-aeb6-12e177657219 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:06:39 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-84794013-32d0-4906-a7f1-3702a23b5c80 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219" status: 404 len: 111 microversion: 2.1 time: 0.034947 Nov 28 14:06:39 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 210/629] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:39 2023] GET /compute/v2.1/servers/ea32aeb2-975a-4295-aeb6-12e177657219 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:06:39 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-08a38c63-70c6-499c-bd71-b4868d7b3bcc tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '.version_select at 0x7fedf09e71c0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-08a38c63-70c6-499c-bd71-b4868d7b3bcc tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-423384039" status: 202 len: 0 microversion: 2.1 time: 0.023231 Nov 28 14:06:39 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 212/630] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Nov 28 14:06:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-423384039 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:06:40 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:40 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Creating event network-changed:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:06:40 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Nov 28 14:06:40 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 209/631] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:40 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02461b60e13a4db999369d87c2e426e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e6f2f181214fa494ee8b5ca7eaad86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-024a6d15-fa69-4f73-91ba-5c5603952882 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91" status: 200 len: 1483 microversion: 2.1 time: 0.206364 Nov 28 14:06:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 211/632] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:40 2023] GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91 => generated 1483 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:41 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:41 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d057a526-9db3-4e9c-88bb-7d7dcd7c87f2 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 200 len: 1543 microversion: 2.1 time: 0.224816 Nov 28 14:06:41 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 213/633] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:41 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 1543 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:41 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ec64b5ab-93ed-4bf9-ae00-fe11f86c8521 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'create', calling method: .version_select at 0x7fedf09dc160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-61460895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa19ae4ZpRTk8W8Dy0ei1mbIqo2DyDhgzSWjJaNvQeFzWl77MekDwIF3aQsbXH5GjTuclZvjusBW70UuFW4tBl6XBUDa/gQEGo6iKrUvg98hB7Vo/QDIUMrAZNkg2P19Q=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:41 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-ec64b5ab-93ed-4bf9-ae00-fe11f86c8521 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for project f4056ca714ed4e85878d7819ef63b20c. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:41 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-ec64b5ab-93ed-4bf9-ae00-fe11f86c8521 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for user e109047aa8a34d8aad03c6c0dc14c7c8 and project f4056ca714ed4e85878d7819ef63b20c. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:41 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ec64b5ab-93ed-4bf9-ae00-fe11f86c8521 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.043435 Nov 28 14:06:41 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 210/634] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:06:41 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:41 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-302157245", "imageRef": "6530f2f4-cb90-4204-90fe-226e4fc806c7", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-61460895", "networks": [{"uuid": "ba428b8f-0c0f-4327-be18-5f08025368bf"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:41 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] validate_networks() for [('ba428b8f-0c0f-4327-be18-5f08025368bf', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:06:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:06:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037283 Nov 28 14:06:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 214/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for project f4056ca714ed4e85878d7819ef63b20c. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting quotas for user e109047aa8a34d8aad03c6c0dc14c7c8 and project f4056ca714ed4e85878d7819ef63b20c. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:06:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6530f2f4-cb90-4204-90fe-226e4fc806c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:06:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.809284 Nov 28 14:06:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 212/636] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:06:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:06:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1fccf1e6-f097-4289-8d39-39a818391c6c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1fccf1e6-f097-4289-8d39-39a818391c6c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:42 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-1fccf1e6-f097-4289-8d39-39a818391c6c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1fccf1e6-f097-4289-8d39-39a818391c6c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 200 len: 1248 microversion: 2.1 time: 0.062057 Nov 28 14:06:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 211/637] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:42 2023] GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 1248 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:06:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060273 Nov 28 14:06:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 215/638] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea60b55-d974-4262-9413-37459394f8a6", "tag": "8b8020db-6358-4061-8494-c21f704791fb"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Creating event network-changed:8b8020db-6358-4061-8494-c21f704791fb for instance 8ea60b55-d974-4262-9413-37459394f8a6 on user Nov 28 14:06:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034941 Nov 28 14:06:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 213/639] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea60b55-d974-4262-9413-37459394f8a6", "name": "network-vif-plugged", "status": "completed", "tag": "8b8020db-6358-4061-8494-c21f704791fb"}, {"server_uuid": "8ea60b55-d974-4262-9413-37459394f8a6", "name": "network-vif-plugged", "status": "completed", "tag": "8b8020db-6358-4061-8494-c21f704791fb"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Creating event network-vif-plugged:8b8020db-6358-4061-8494-c21f704791fb for instance 8ea60b55-d974-4262-9413-37459394f8a6 on user Nov 28 14:06:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Creating event network-vif-plugged:8b8020db-6358-4061-8494-c21f704791fb for instance 8ea60b55-d974-4262-9413-37459394f8a6 on user Nov 28 14:06:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034486 Nov 28 14:06:48 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 212/640] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-bb87cb66-ea02-4bd0-8efa-f4878f714c12 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.139244 Nov 28 14:06:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 216/641] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 14:06:51 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:06:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Creating event network-changed:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:06:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034533 Nov 28 14:06:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 214/642] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-933a9e8e-137e-43ba-9512-a6c5a86eb865 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/ips" status: 200 len: 109 microversion: 2.20 time: 0.038686 Nov 28 14:06:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 213/643] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 14:06:52 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:54 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2074db2a-c22e-41fd-8ce8-756213b2c965 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 200 len: 1533 microversion: 2.1 time: 0.217940 Nov 28 14:06:54 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 217/644] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:06:54 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 1533 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:55 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'flavor' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:06:56 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/action" status: 202 len: 0 microversion: 2.20 time: 0.898453 Nov 28 14:06:56 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 215/645] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:06:55 2023] POST /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:56 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:06:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-285cad3f-2b2b-44c6-8073-2cf6a0b4cb45 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1708 microversion: 2.20 time: 0.165552 Nov 28 14:06:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 214/646] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:06:56 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:06:56 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-unplugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Creating event network-vif-unplugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:06:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092716 Nov 28 14:06:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 218/647] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:06:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-plugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:06:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:06:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:06:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:06:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Creating event network-vif-plugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:06:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043563 Nov 28 14:06:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 216/648] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:06:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:07:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Creating event network-changed:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:07:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033242 Nov 28 14:07:02 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 215/649] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1272274120", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "3bfd3351-2c37-456a-b7b8-e306bd80afb4"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] validate_networks() for [('3bfd3351-2c37-456a-b7b8-e306bd80afb4', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for user f88c92554f0f44b0be661aa40aec8670 and project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:07:03 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:07:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.515060 Nov 28 14:07:03 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 219/650] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:07:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:07:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e79680a0-f03e-4b9b-a925-04e89cd6fef8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:03 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-e79680a0-f03e-4b9b-a925-04e89cd6fef8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:03 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-e79680a0-f03e-4b9b-a925-04e89cd6fef8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:03 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-e79680a0-f03e-4b9b-a925-04e89cd6fef8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:03 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-e79680a0-f03e-4b9b-a925-04e89cd6fef8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e79680a0-f03e-4b9b-a925-04e89cd6fef8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1395 microversion: 2.87 time: 0.090931 Nov 28 14:07:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 217/651] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:07:03 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1395 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 14:07:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Creating event network-changed:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:07:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040986 Nov 28 14:07:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 216/652] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:07 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2a50791634583ace0b93cb1459256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b698cd76-ceab-4256-b33f-44f9ace95d5e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5" status: 200 len: 1562 microversion: 2.1 time: 0.195508 Nov 28 14:07:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 220/653] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:07:07 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5 => generated 1562 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:13 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Creating event network-changed:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034573 Nov 28 14:07:13 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 217/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:13 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:07:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 204 len: 0 microversion: 2.1 time: 0.193531 Nov 28 14:07:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 218/655] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:07:13 2023] DELETE /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-unplugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Creating event network-vif-unplugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:07:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042748 Nov 28 14:07:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 218/656] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:14 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:14 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-67119c3d-b26e-455c-8c1d-03e858a0491f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 200 len: 1556 microversion: 2.1 time: 0.391815 Nov 28 14:07:14 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 221/657] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:07:14 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 1556 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:15 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-deleted", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:15 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] Creating event network-vif-deleted:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:07:15 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048173 Nov 28 14:07:15 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 219/658] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:16 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0f9c9ba4-fbdf-47cf-8ef0-e37d4c0a7499 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f" status: 200 len: 1485 microversion: 2.1 time: 0.268428 Nov 28 14:07:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 219/659] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:07:15 2023] GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f => generated 1485 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:07:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807c145e-9d41-4a76-8777-c033276ba96a", "name": "network-vif-plugged", "status": "completed", "tag": "36fe7f7b-64c5-47bd-815b-b61516ad2167"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Creating event network-vif-plugged:36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance 807c145e-9d41-4a76-8777-c033276ba96a on user Nov 28 14:07:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Nov 28 14:07:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 222/660] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:07:21 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222254 Nov 28 14:07:21 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 220/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:07:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Nov 28 14:07:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 220/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=46 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:27 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0daec775-fc73-455c-930b-e72e68b73ef4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1544 microversion: 2.1 time: 0.200557 Nov 28 14:07:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 223/663] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:07:27 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1544 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=28 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:32 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-fa471757-5bdd-4be8-9f3e-8e223269f3bb tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 200 len: 1532 microversion: 2.1 time: 0.221224 Nov 28 14:07:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 221/664] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:07:32 2023] GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 1532 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:41 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:41 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-653de211-b677-4a28-b336-9286d403a7d1 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.145265 Nov 28 14:07:41 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 221/665] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:07:41 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-interface => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:07:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Creating event network-changed:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:07:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034006 Nov 28 14:07:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 224/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d3f88a7d-edd9-4275-948f-af3c8881925d tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/ips" status: 200 len: 108 microversion: 2.1 time: 0.036819 Nov 28 14:07:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 222/667] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 14:07:42 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcfdd796-6e32-4d42-8d36-7b15bba7360f"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333679 Nov 28 14:07:45 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 222/668] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:07:45 2023] POST /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:46 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8ccb2687-3f0f-47cd-87df-91da61e27116 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1649 microversion: 2.20 time: 0.204530 Nov 28 14:07:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 225/669] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:07:46 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1649 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:07:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91" status: 204 len: 0 microversion: 2.1 time: 0.115224 Nov 28 14:07:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 223/670] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:07:47 2023] DELETE /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:48 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02461b60e13a4db999369d87c2e426e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e6f2f181214fa494ee8b5ca7eaad86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-537b0339-2f1b-444f-880b-a2b2b51f3722 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91" status: 200 len: 1489 microversion: 2.1 time: 0.279008 Nov 28 14:07:48 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:07:47 2023] GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91 => generated 1489 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:07:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93312f50-72e0-4d65-a125-e6101ad73c91", "name": "network-vif-unplugged", "status": "completed", "tag": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Creating event network-vif-unplugged:ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance 93312f50-72e0-4d65-a125-e6101ad73c91 on user Nov 28 14:07:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029635 Nov 28 14:07:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 226/672] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93312f50-72e0-4d65-a125-e6101ad73c91", "name": "network-vif-deleted", "tag": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] Creating event network-vif-deleted:ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance 93312f50-72e0-4d65-a125-e6101ad73c91 on user Nov 28 14:07:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114759 Nov 28 14:07:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 224/673] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:50 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93312f50-72e0-4d65-a125-e6101ad73c91", "name": "network-vif-plugged", "status": "completed", "tag": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Creating event network-vif-plugged:ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance 93312f50-72e0-4d65-a125-e6101ad73c91 on user Nov 28 14:07:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034315 Nov 28 14:07:50 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 224/674] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:53 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:07:53 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-98543cfd-c335-4c5e-a442-ffc47b4a5988 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1769 microversion: 2.87 time: 0.217205 Nov 28 14:07:53 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 227/675] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:07:53 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1769 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-68493f46-91ff-4d57-a2de-13c5cf5c126f tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.196657 Nov 28 14:07:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 225/676] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:07:54 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-interface => generated 282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'services' on Instance uuid 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:07:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments/fcfdd796-6e32-4d42-8d36-7b15bba7360f" status: 202 len: 0 microversion: 2.1 time: 0.233364 Nov 28 14:07:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 225/677] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:07:55 2023] DELETE /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments/fcfdd796-6e32-4d42-8d36-7b15bba7360f => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9a17acac-5b05-43f5-ab1d-03b8a63d94b6 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041085 Nov 28 14:07:55 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 228/678] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:07:55 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Creating event network-changed:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:07:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039974 Nov 28 14:07:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 226/679] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8b21fb41-3e03-4441-a963-caa2cf5fcbfb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/ips" status: 200 len: 103 microversion: 2.1 time: 0.034921 Nov 28 14:07:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 226/680] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 14:07:55 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/ips => generated 103 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:07:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:07:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267049 Nov 28 14:07:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 229/681] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:07:58 2023] POST /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] HTTP exception thrown: Instance 807c145e-9d41-4a76-8777-c033276ba96a could not be found. Nov 28 14:08:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Returning 404 to user: Instance 807c145e-9d41-4a76-8777-c033276ba96a could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:08:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-23fb80c0-3c7b-426e-9816-1abdf59912b1 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a" status: 404 len: 111 microversion: 2.1 time: 0.037465 Nov 28 14:08:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 227/682] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:04 2023] GET /compute/v2.1/servers/807c145e-9d41-4a76-8777-c033276ba96a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:08:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f36a3b7b-304a-4df0-9ff8-e5112155dd73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Calling method '.version_select at 0x7fedf06d1d80>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f36a3b7b-304a-4df0-9ff8-e5112155dd73 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1470109784" status: 202 len: 0 microversion: 2.1 time: 0.020693 Nov 28 14:08:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 227/683] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 14:08:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1470109784 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d27647ef-da6d-4e6b-a4c9-6c3091255356 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.185846 Nov 28 14:08:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 230/684] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:08:07 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-bc8ac4c0-13d1-4b69-8930-c0c5df836107 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055557 Nov 28 14:08:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 228/685] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:08:08 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-2d19ec03-0c1b-41b2-8bd0-a7f952cda93d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4" status: 200 len: 194 microversion: 2.1 time: 0.048399 Nov 28 14:08:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 228/686] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 14:08:08 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Creating event network-changed:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:08:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035921 Nov 28 14:08:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 231/687] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:09 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2a50791634583ace0b93cb1459256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-06ee3383-ef60-44ae-a7ae-19b15607e171 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5" status: 200 len: 1562 microversion: 2.1 time: 0.235934 Nov 28 14:08:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 229/688] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:09 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9d2a50791634583ace0b93cb1459256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Searching by: {'deleted': False, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5'} {{(pid=65027) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:09 user devstack@n-api.service[65027]: DEBUG nova.compute.multi_cell_list [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65027) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 14:08:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1478aa25-7108-4567-9ce8-ca34ba999ab7 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 351 microversion: 2.1 time: 0.153908 Nov 28 14:08:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 229/689] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 14:08:09 2023] GET /compute/v2.1/servers => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d06aa0b6-3395-4fb7-ad77-b637fad36102"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:10 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:10 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325332 Nov 28 14:08:10 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 232/690] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:08:10 2023] POST /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4f3128e-03e1-4626-9cff-99ae0d0546d9"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339468 Nov 28 14:08:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 230/691] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:08:10 2023] POST /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:08:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f" status: 204 len: 0 microversion: 2.1 time: 0.129735 Nov 28 14:08:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 230/692] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:08:17 2023] DELETE /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:17 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-02d05a78-1b59-4abc-8104-d300902461bc tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f" status: 200 len: 1491 microversion: 2.1 time: 0.337537 Nov 28 14:08:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 233/693] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:17 2023] GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f => generated 1491 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e0a0a1-9ed0-4f33-8a44-33649338b57f", "name": "network-vif-unplugged", "status": "completed", "tag": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Creating event network-vif-unplugged:152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f on user Nov 28 14:08:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040186 Nov 28 14:08:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 231/694] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e0a0a1-9ed0-4f33-8a44-33649338b57f", "name": "network-vif-plugged", "status": "completed", "tag": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc"}, {"server_uuid": "85e0a0a1-9ed0-4f33-8a44-33649338b57f", "name": "network-vif-deleted", "tag": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:20 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Creating event network-vif-plugged:152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f on user Nov 28 14:08:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Creating event network-vif-deleted:152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f on user Nov 28 14:08:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033130 Nov 28 14:08:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 231/695] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2cc08044-aa37-41da-8b06-76ee193682ef req-9bd2fd7b-275d-4825-912d-6fb7c872adb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 200 len: 302 microversion: 2.89 time: 0.174216 Nov 28 14:08:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 234/696] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:08:21 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f04ffa58-7f2e-4dbe-9ca1-167b20355bb4 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055082 Nov 28 14:08:21 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 232/697] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:08:21 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d02a9e61-0159-446a-95d2-defff3493094 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4" status: 200 len: 194 microversion: 2.1 time: 0.050445 Nov 28 14:08:21 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 232/698] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 14:08:21 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b0e376aa-3857-476f-8e0b-44a39bc2e900 req-e6f1b8c8-1b6e-462e-9849-d771d531b790 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 200 len: 302 microversion: 2.89 time: 0.117209 Nov 28 14:08:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 235/699] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:08:21 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:21 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'services' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:08:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4" status: 202 len: 0 microversion: 2.1 time: 0.213093 Nov 28 14:08:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 233/700] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:08:21 2023] DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG nova.compute.api [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a40cb6f2-e1cf-4834-82b8-cd1fc2314aaa req-1ecd87d6-1307-4285-8a2c-7d514cf1b2b0 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 200 len: 302 microversion: 2.89 time: 0.100638 Nov 28 14:08:22 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 233/701] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:08:22 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-fcaf51b8-77f1-408f-ac39-0ae9c33e0f39 req-33f4a8e0-0c54-4b56-9f19-8d750140db87 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 200 len: 302 microversion: 2.89 time: 0.093735 Nov 28 14:08:22 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 236/702] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:08:22 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-09dc99e4-8583-43ac-9179-cff66114c549 req-a4749d9f-044b-484a-9070-d98346dadd3c tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 200 len: 302 microversion: 2.89 time: 0.093156 Nov 28 14:08:23 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 234/703] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:08:23 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG nova.compute.api [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2818893f-0bfa-4b2b-af0a-86c6993f141c req-9609af98-a1e2-49d5-89c5-1dca8aba00f0 tempest-TestServerVolumeAttachmentScenario-1544506436 tempest-TestServerVolumeAttachmentScenario-1544506436-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 200 len: 302 microversion: 2.89 time: 0.093624 Nov 28 14:08:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 234/704] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:08:23 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f244b423-f355-4580-8bd2-7c56e8311902"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291173 Nov 28 14:08:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 237/705] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:08:23 2023] POST /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-326c7ae1-6c3e-41d8-ab08-e0f6a75f79cd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.245434 Nov 28 14:08:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 235/706] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:08:28 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-interface => generated 283 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Creating event network-changed:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:08:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Nov 28 14:08:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 235/707] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:30 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8db1a2dc-3e8e-4431-8924-79a27e2e223c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1663 microversion: 2.1 time: 0.193865 Nov 28 14:08:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 238/708] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:30 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1663 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38b03b35-b011-46d4-ab6f-2bd994f14c47"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367318 Nov 28 14:08:30 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 236/709] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:08:30 2023] POST /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:33 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9a6b149b-406f-4955-a498-befc4657e4fa tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 200 len: 1532 microversion: 2.1 time: 0.586977 Nov 28 14:08:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 236/710] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:32 2023] GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 1532 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching by: {'deleted': False, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c'} {{(pid=65025) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:33 user devstack@n-api.service[65025]: DEBUG nova.compute.multi_cell_list [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65025) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 14:08:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-47b22739-93ba-446e-8155-afac909da2d8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.183068 Nov 28 14:08:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 239/711] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 14:08:33 2023] GET /compute/v2.1/servers => generated 340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:33 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:33 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-b7cec1d0-f70a-4ab5-a371-94d2e29b2f9b tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 200 len: 1532 microversion: 2.1 time: 0.233501 Nov 28 14:08:33 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:33 2023] GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 1532 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:35 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'services' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:08:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/f244b423-f355-4580-8bd2-7c56e8311902" status: 202 len: 0 microversion: 2.1 time: 0.179238 Nov 28 14:08:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 237/713] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:08:35 2023] DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/f244b423-f355-4580-8bd2-7c56e8311902 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0c3c5a2e-1952-4268-8b79-b77ea1c6b838 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046970 Nov 28 14:08:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 240/714] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:08:35 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61c9a94-0cbd-4b8c-99e1-eb121cf304a4"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334916 Nov 28 14:08:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 238/715] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:08:36 2023] POST /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] HTTP exception thrown: Instance 93312f50-72e0-4d65-a125-e6101ad73c91 could not be found. Nov 28 14:08:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Returning 404 to user: Instance 93312f50-72e0-4d65-a125-e6101ad73c91 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:08:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1caec976-80df-4e3e-a458-955d18d0116c tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91" status: 404 len: 111 microversion: 2.1 time: 0.036058 Nov 28 14:08:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 238/716] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:38 2023] GET /compute/v2.1/servers/93312f50-72e0-4d65-a125-e6101ad73c91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:41 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-55ea8384-a64d-4f36-b529-609a220e015d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1709 microversion: 2.1 time: 0.219470 Nov 28 14:08:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 241/717] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:41 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-1998050807", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: dict_keys(['metadata_items']) {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: dict_keys(['metadata_items']) {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/action" status: 202 len: 1163 microversion: 2.1 time: 0.468223 Nov 28 14:08:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 239/718] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Nov 28 14:08:42 2023] POST /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/action => generated 1163 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:42 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4c390800-f161-407e-a3a4-68ca337a49f3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1736 microversion: 2.1 time: 0.255791 Nov 28 14:08:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 239/719] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:42 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-unplugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:43 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=39 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:43 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=112,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Creating event network-vif-unplugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:08:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041534 Nov 28 14:08:43 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 242/720] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f0a11918-70df-4036-95b6-21525365ea6a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/b4f3128e-03e1-4626-9cff-99ae0d0546d9" status: 200 len: 194 microversion: 2.1 time: 0.048588 Nov 28 14:08:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 240/721] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 14:08:44 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/b4f3128e-03e1-4626-9cff-99ae0d0546d9 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:44 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'services' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:08:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/b4f3128e-03e1-4626-9cff-99ae0d0546d9" status: 202 len: 0 microversion: 2.1 time: 0.225529 Nov 28 14:08:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 240/722] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:08:44 2023] DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments/b4f3128e-03e1-4626-9cff-99ae0d0546d9 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:08:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035987 Nov 28 14:08:45 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 243/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-12458f02-67f6-4670-8798-0b0d0a784208 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047361 Nov 28 14:08:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 241/724] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:08:45 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:45 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:08:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 204 len: 0 microversion: 2.1 time: 0.175311 Nov 28 14:08:45 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 241/725] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:08:45 2023] DELETE /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:46 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-7572750f-f457-49ab-b882-9b1218ac1f2f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 200 len: 1668 microversion: 2.1 time: 0.330934 Nov 28 14:08:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 244/726] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:08:45 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ed5746-e152-40d9-b8c7-b33905d5b549"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7e9357d4-2b4b-4808-ab60-fd3638727f83 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362605 Nov 28 14:08:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 242/727] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 14:08:46 2023] POST /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "name": "network-vif-unplugged", "status": "completed", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}, {"server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "name": "network-vif-plugged", "status": "completed", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:47 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65027) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 14:08:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Creating event network-vif-unplugged:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:08:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Creating event network-vif-plugged:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:08:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044380 Nov 28 14:08:47 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 245/728] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/action" status: 202 len: 0 microversion: 2.20 time: 0.105858 Nov 28 14:08:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 242/729] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:08:47 2023] POST /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:47 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8eb6d724-879c-44c6-80dc-d31a1c00e4f2 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1735 microversion: 2.20 time: 0.332293 Nov 28 14:08:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 243/730] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:08:47 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1735 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:08:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c994fe4-2ec9-497f-9069-1fbbfafa3410", "name": "network-vif-deleted", "tag": "26578bc1-9515-4ec1-a156-a2a6de8681cf"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] Creating event network-vif-deleted:26578bc1-9515-4ec1-a156-a2a6de8681cf for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 on user Nov 28 14:08:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046232 Nov 28 14:08:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 246/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "585d85f4-5648-40af-8947-50dcedfdabe0"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:54 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'flavor' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:08:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23/action" status: 200 len: 29 microversion: 2.87 time: 0.614130 Nov 28 14:08:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 243/732] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:08:54 2023] POST /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23/action => generated 29 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:55 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:08:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-dad544b2-c34e-4c15-b732-b86165459b59 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1775 microversion: 2.87 time: 0.495075 Nov 28 14:08:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 244/733] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:08:54 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1775 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:08:56 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-unplugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Creating event network-vif-unplugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:08:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053697 Nov 28 14:08:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 247/734] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:08:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041950 Nov 28 14:08:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 244/735] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:08:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:08:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:08:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:08:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:08:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:08:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029318 Nov 28 14:08:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 245/736] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:01 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:09:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067469 Nov 28 14:09:01 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 248/737] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}, {"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Creating event network-changed:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:09:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:09:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056463 Nov 28 14:09:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 245/738] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:02 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:03 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:09:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039899 Nov 28 14:09:03 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 246/739] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] HTTP exception thrown: Instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f could not be found. Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Returning 404 to user: Instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6ab1bb25-b312-4d23-bb44-5ae5854c809e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f" status: 404 len: 111 microversion: 2.1 time: 0.041522 Nov 28 14:09:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 249/740] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:08 2023] GET /compute/v2.1/servers/85e0a0a1-9ed0-4f33-8a44-33649338b57f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-274e5b30-ca0a-4a9b-9caf-bb364a942d2d tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067276 Nov 28 14:09:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 246/741] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:09:08 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-465880070", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "39e05b38-9721-451b-a6d4-fa95e025bcc2"}]}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] validate_networks() for [('39e05b38-9721-451b-a6d4-fa95e025bcc2', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4afa9db7-7bd6-4efe-bf59-a4bb7be40c08 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064332 Nov 28 14:09:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 250/742] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:09:08 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=136,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:09:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 204 len: 0 microversion: 2.1 time: 0.202037 Nov 28 14:09:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 247/743] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:09:08 2023] DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Getting quotas for project d70602cf7cc04aed9d9f010e82cd37b3. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Getting quotas for user e4918246c1354b6a923ed07fd6136069 and project d70602cf7cc04aed9d9f010e82cd37b3. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:09:08 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:09:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.768726 Nov 28 14:09:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 247/744] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:09:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:09:09 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-62884556-48a1-488e-9416-ccf78b78883c tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:09 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-62884556-48a1-488e-9416-ccf78b78883c tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:09 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-62884556-48a1-488e-9416-ccf78b78883c tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-62884556-48a1-488e-9416-ccf78b78883c tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3" status: 200 len: 1205 microversion: 2.1 time: 0.183415 Nov 28 14:09:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 248/745] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:09 2023] GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3 => generated 1205 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:09:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "name": "network-vif-unplugged", "status": "completed", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:09 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e46cc85e-e5a4-41f7-a8e6-14c7c0ddbe3c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 200 len: 1658 microversion: 2.1 time: 0.537506 Nov 28 14:09:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 251/746] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:08 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 1658 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:09:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Creating event network-vif-unplugged:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:09:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043433 Nov 28 14:09:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 248/747] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-plugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Creating event network-vif-plugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:09:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079891 Nov 28 14:09:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 249/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "name": "network-vif-plugged", "status": "completed", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Creating event network-vif-plugged:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:09:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031386 Nov 28 14:09:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 252/749] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c", "name": "network-vif-deleted", "tag": "fe80bff8-4392-40bb-942f-b2095b29199c"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] Creating event network-vif-deleted:fe80bff8-4392-40bb-942f-b2095b29199c for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c on user Nov 28 14:09:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043935 Nov 28 14:09:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 249/750] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:12 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-plugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Creating event network-vif-plugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:09:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Nov 28 14:09:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 250/751] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:13 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee48951-d5c7-4d89-ab05-766bbaf2edc3", "tag": "8df9d722-c1e7-4a3f-9631-ebf0acff9425"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Creating event network-changed:8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 on user Nov 28 14:09:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 Nov 28 14:09:13 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 253/752] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee48951-d5c7-4d89-ab05-766bbaf2edc3", "name": "network-vif-plugged", "status": "completed", "tag": "8df9d722-c1e7-4a3f-9631-ebf0acff9425"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Creating event network-vif-plugged:8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 on user Nov 28 14:09:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059134 Nov 28 14:09:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 250/753] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee48951-d5c7-4d89-ab05-766bbaf2edc3", "name": "network-vif-plugged", "status": "completed", "tag": "8df9d722-c1e7-4a3f-9631-ebf0acff9425"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:09:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Creating event network-vif-plugged:8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 on user Nov 28 14:09:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037800 Nov 28 14:09:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 251/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=23 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=35 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2bdc4036-e81f-4b4d-9a4d-70ba4bf6c812 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053526 Nov 28 14:09:25 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 254/755] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:09:25 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=10,nova_cell1:INSERT=6,nova_cell1:DELETE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:25 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'services' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:09:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 202 len: 0 microversion: 2.1 time: 0.188156 Nov 28 14:09:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 251/756] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:09:25 2023] DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-19c99da4-2bdd-4ac3-b551-4b692b07b5b4 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048781 Nov 28 14:09:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 252/757] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:09:25 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:33 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-dc730e6c-3ccd-400e-b5e3-251e17ce8348 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1727 microversion: 2.1 time: 0.851905 Nov 28 14:09:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 255/758] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:33 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1727 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 could not be found. Nov 28 14:09:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4b83cf15-5c14-4f09-92e3-c37d0ce49f14 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 404 len: 111 microversion: 2.1 time: 0.054259 Nov 28 14:09:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 252/759] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:36 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:36 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:36 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:36 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-debe6754-964b-4f23-8d55-cd5e3f83cd6c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '.version_select at 0x7fedf0158670>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:36 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-debe6754-964b-4f23-8d55-cd5e3f83cd6c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464159864" status: 202 len: 0 microversion: 2.1 time: 0.049012 Nov 28 14:09:36 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 253/760] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:09:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464159864 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:38 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:38 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:38 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-72a4af39-0291-4476-b77a-a35b90bfb273 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1780 microversion: 2.20 time: 0.303476 Nov 28 14:09:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 256/761] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:09:37 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1780 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:40 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 could not be found. Nov 28 14:09:40 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:40 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d6b32f8a-20f1-4f15-8f10-fd9758551ac5 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 404 len: 111 microversion: 2.1 time: 0.048050 Nov 28 14:09:40 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 253/762] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:09:40 2023] DELETE /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 could not be found. Nov 28 14:09:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-72fc246f-16b9-4811-ae66-bc649165909f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410" status: 404 len: 111 microversion: 2.1 time: 0.030750 Nov 28 14:09:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 254/763] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:40 2023] GET /compute/v2.1/servers/2c994fe4-2ec9-497f-9069-1fbbfafa3410 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 could not be found. Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9666e61e-a985-4dd6-93ea-42ffa6e7762c tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 404 len: 111 microversion: 2.1 time: 0.026136 Nov 28 14:09:43 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 257/764] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:09:43 2023] DELETE /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 could not be found. Nov 28 14:09:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-43aee314-0a93-478c-9d17-71693fdf8478 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784" status: 404 len: 111 microversion: 2.1 time: 0.030982 Nov 28 14:09:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 254/765] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:43 2023] GET /compute/v2.1/servers/3aa772d7-ca30-4a90-b326-3450f9e28784 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 could not be found. Nov 28 14:09:43 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3d2c6300-10ca-4669-9053-25f9d197cbc3 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 404 len: 111 microversion: 2.1 time: 0.031021 Nov 28 14:09:43 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 255/766] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:09:43 2023] DELETE /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 could not be found. Nov 28 14:09:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0587ad8f-6113-4003-b903-1981ecf377d8 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0" status: 404 len: 111 microversion: 2.1 time: 0.027765 Nov 28 14:09:43 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 258/767] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:43 2023] GET /compute/v2.1/servers/982e2518-5a29-4c35-b9e1-61e7401a4fd0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:45 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e9797cf7-0afc-44b9-9fc7-52b05d21c097 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1755 microversion: 2.87 time: 0.524646 Nov 28 14:09:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 255/768] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:09:45 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1755 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 949a3612-5042-420f-9911-ec641017d399 could not be found. Nov 28 14:09:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 949a3612-5042-420f-9911-ec641017d399 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-40d43e6f-9274-4330-b2b9-59f1960dbe3f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 404 len: 111 microversion: 2.1 time: 0.039983 Nov 28 14:09:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 256/769] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:09:47 2023] DELETE /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HTTP exception thrown: Instance 949a3612-5042-420f-9911-ec641017d399 could not be found. Nov 28 14:09:47 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Returning 404 to user: Instance 949a3612-5042-420f-9911-ec641017d399 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-38340285-816e-43c9-a070-865c5dd85feb tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399" status: 404 len: 111 microversion: 2.1 time: 0.039153 Nov 28 14:09:47 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 259/770] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:47 2023] GET /compute/v2.1/servers/949a3612-5042-420f-9911-ec641017d399 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=12 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:09:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HTTP exception thrown: Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c could not be found. Nov 28 14:09:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Returning 404 to user: Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:09:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-891e3447-08a3-4103-91d0-be2d0a927d9c tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 404 len: 111 microversion: 2.1 time: 0.033913 Nov 28 14:09:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 257/771] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:59 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:09:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2dbc9507-1d88-428d-9d86-06d301fa2034 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '.version_select at 0x7fedf09e6440>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:09:59 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=12 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:59 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=24 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:09:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2dbc9507-1d88-428d-9d86-06d301fa2034 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391843838" status: 202 len: 0 microversion: 2.1 time: 0.026094 Nov 28 14:09:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 260/772] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:09:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391843838 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:09:59 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:09:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0b475d97-5cda-4cda-b4ec-bdab0b989254 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3" status: 200 len: 1484 microversion: 2.1 time: 0.222355 Nov 28 14:09:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 256/773] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:09:59 2023] GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3 => generated 1484 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HTTP exception thrown: Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c could not be found. Nov 28 14:10:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Returning 404 to user: Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:10:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-72ded83d-5c79-42ae-afb2-8dfda43b0df0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 404 len: 111 microversion: 2.1 time: 0.025711 Nov 28 14:10:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 258/774] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:10:06 2023] DELETE /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HTTP exception thrown: Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c could not be found. Nov 28 14:10:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Returning 404 to user: Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:10:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-62463221-c04a-46d9-8faa-d543808504cb tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" status: 404 len: 111 microversion: 2.1 time: 0.029006 Nov 28 14:10:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 261/775] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:10:06 2023] GET /compute/v2.1/servers/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HTTP exception thrown: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. Nov 28 14:10:10 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Returning 404 to user: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:10:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-866cf43b-65de-43f9-906b-f402289d30a0 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 404 len: 111 microversion: 2.1 time: 0.036640 Nov 28 14:10:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 257/776] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:10:10 2023] DELETE /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HTTP exception thrown: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. Nov 28 14:10:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Returning 404 to user: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:10:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-124ec9d8-2eff-4f68-b866-e3663d72d915 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4" status: 404 len: 111 microversion: 2.1 time: 0.030000 Nov 28 14:10:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 259/777] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:10:10 2023] GET /compute/v2.1/servers/10e135e2-a52b-437c-adb6-3fb81daf17e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:10:14 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4143e9da-933a-4e44-b04f-9c3e47179a9e tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Action: 'create', calling method: .version_select at 0x7fedf0415b40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1608632560", "metadata": {"Type": "work"}}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:15 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4143e9da-933a-4e44-b04f-9c3e47179a9e tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.484473 Nov 28 14:10:15 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 262/778] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 14:10:14 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 486 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 14:10:15 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-28f6eb68-0da2-489d-92c3-2df7f4cf4dce tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf0360160>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:15 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-28f6eb68-0da2-489d-92c3-2df7f4cf4dce tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 353 microversion: 2.1 time: 0.060626 Nov 28 14:10:15 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 258/779] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:15 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b5afa2ec-afa1-44d2-b34c-c7465545b9b2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045065 Nov 28 14:10:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 260/780] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:10:15 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] HTTP exception thrown: Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 is not attached to volume d06aa0b6-3395-4fb7-ad77-b637fad36102 Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Returning 404 to user: Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 is not attached to volume d06aa0b6-3395-4fb7-ad77-b637fad36102 {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:10:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-234fe019-a323-4232-8a69-6755047fca14 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102" status: 404 len: 154 microversion: 2.1 time: 0.106295 Nov 28 14:10:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 263/781] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:10:16 2023] DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5/os-volume_attachments/d06aa0b6-3395-4fb7-ad77-b637fad36102 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:10:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b481983a-bde4-4604-b94e-e638f2962b5a tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf0581a20>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5" status: 204 len: 0 microversion: 2.1 time: 0.139057 Nov 28 14:10:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 259/782] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:10:16 2023] DELETE /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b481983a-bde4-4604-b94e-e638f2962b5a tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 353 microversion: 2.1 time: 0.086433 Nov 28 14:10:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 261/783] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:16 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:16 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2a50791634583ace0b93cb1459256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:10:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e14d157d-5832-4962-95aa-469524eaa2a6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5" status: 200 len: 1686 microversion: 2.1 time: 0.285131 Nov 28 14:10:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 264/784] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:10:16 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5 => generated 1686 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "name": "network-vif-unplugged", "status": "completed", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Creating event network-vif-unplugged:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:10:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033705 Nov 28 14:10:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 260/785] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:10:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5d2ddbda-ad93-4cc6-863f-6b81f4cf1c31 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf0330c10>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-5d2ddbda-ad93-4cc6-863f-6b81f4cf1c31 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 354 microversion: 2.1 time: 0.053782 Nov 28 14:10:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 262/786] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:17 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d9adbcd3-ca07-4a5d-9e86-ade2cf24cd87 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf1e917e0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d9adbcd3-ca07-4a5d-9e86-ade2cf24cd87 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 354 microversion: 2.1 time: 0.063570 Nov 28 14:10:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 265/787] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:17 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:17 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8f7b1034-9beb-4cd3-a5b6-14557be54ef0 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf021f7f0>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8f7b1034-9beb-4cd3-a5b6-14557be54ef0 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 202 len: 0 microversion: 2.1 time: 0.152399 Nov 28 14:10:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 261/788] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 14:10:17 2023] DELETE /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:10:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1d38e1fc-db88-43e2-9209-526610f6be59 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf0478280>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1d38e1fc-db88-43e2-9209-526610f6be59 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 353 microversion: 2.1 time: 0.064973 Nov 28 14:10:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 263/789] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:17 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "name": "network-vif-plugged", "status": "completed", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}, {"server_uuid": "bed61555-342d-46bc-95c6-4f94b8c5bbe5", "name": "network-vif-deleted", "tag": "0ba0a0df-c224-46cd-b429-d360d113d576"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Creating event network-vif-plugged:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:10:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Creating event network-vif-deleted:0ba0a0df-c224-46cd-b429-d360d113d576 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 on user Nov 28 14:10:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032402 Nov 28 14:10:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 266/790] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ec8f4330-9425-4703-ad0c-56fe7c63cb86 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf021f910>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ec8f4330-9425-4703-ad0c-56fe7c63cb86 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 353 microversion: 2.1 time: 0.109505 Nov 28 14:10:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 262/791] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:18 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:19 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d2601209-aba0-4ef8-8d69-455b85b870b6 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf0332440>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d2601209-aba0-4ef8-8d69-455b85b870b6 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 353 microversion: 2.1 time: 0.067963 Nov 28 14:10:19 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 264/792] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:19 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-88525bbe-5fcf-45ec-b670-cb611b590ee9 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf07879a0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-88525bbe-5fcf-45ec-b670-cb611b590ee9 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 200 len: 353 microversion: 2.1 time: 0.068300 Nov 28 14:10:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 267/793] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:20 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9229eb1f-b163-4751-ad7f-7153d3723528 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Calling method '.version_select at 0x7fedf0362050>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-9229eb1f-b163-4751-ad7f-7153d3723528 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] HTTP exception thrown: Volume 5774bd58-0d03-4f84-ae6a-8f7b41db3d03 could not be found. Nov 28 14:10:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9229eb1f-b163-4751-ad7f-7153d3723528 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] Returning 404 to user: Volume 5774bd58-0d03-4f84-ae6a-8f7b41db3d03 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:10:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-9229eb1f-b163-4751-ad7f-7153d3723528 tempest-VolumesGetTestJSON-1099684235 tempest-VolumesGetTestJSON-1099684235-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03" status: 404 len: 109 microversion: 2.1 time: 0.040989 Nov 28 14:10:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 263/794] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:10:22 2023] GET /compute/v2.1/os-volumes/5774bd58-0d03-4f84-ae6a-8f7b41db3d03 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:34 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:10:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-748c43dc-262a-40cc-9880-67b78870eefd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1727 microversion: 2.1 time: 0.402301 Nov 28 14:10:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 265/795] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:10:33 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1727 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=16 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:34 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:10:34 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4efe3136-7564-4c5a-ac78-1810bfbe716e tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1659 microversion: 2.1 time: 0.399290 Nov 28 14:10:34 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 268/796] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:10:34 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1659 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-eab9ada7-1e98-4c46-a1b4-03a5facd725c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments/46ed5746-e152-40d9-b8c7-b33905d5b549" status: 200 len: 194 microversion: 2.20 time: 0.162428 Nov 28 14:10:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 264/797] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Nov 28 14:10:38 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments/46ed5746-e152-40d9-b8c7-b33905d5b549 => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:38 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'services' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:10:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments/46ed5746-e152-40d9-b8c7-b33905d5b549" status: 202 len: 0 microversion: 2.20 time: 0.188079 Nov 28 14:10:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 266/798] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 14:10:38 2023] DELETE /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments/46ed5746-e152-40d9-b8c7-b33905d5b549 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d524cd30-127e-423e-bc5c-ee6b6d2d4bfa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039977 Nov 28 14:10:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 269/799] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 14:10:38 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23/action" status: 202 len: 0 microversion: 2.87 time: 0.087154 Nov 28 14:10:46 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 265/800] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:10:45 2023] POST /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:10:46 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:10:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b8c58171-095b-48b6-abe1-da515b2748aa tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1763 microversion: 2.87 time: 0.250492 Nov 28 14:10:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 267/801] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:10:46 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1763 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:10:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-unplugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Creating event network-vif-unplugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:10:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102219 Nov 28 14:10:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 270/802] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:10:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}, {"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:10:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:10:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057811 Nov 28 14:10:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 266/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:10:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:10:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:10:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:10:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:10:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:10:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036653 Nov 28 14:10:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 268/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:10:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=14 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:00 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:11:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3" status: 204 len: 0 microversion: 2.1 time: 0.302428 Nov 28 14:11:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 271/805] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:11:00 2023] DELETE /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:00 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee48951-d5c7-4d89-ab05-766bbaf2edc3", "name": "network-vif-unplugged", "status": "completed", "tag": "8df9d722-c1e7-4a3f-9631-ebf0acff9425"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:00 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Creating event network-vif-unplugged:8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 on user Nov 28 14:11:00 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051316 Nov 28 14:11:00 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 269/806] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:00 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ea33454d-cded-4f21-a651-c9c966e84280 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3" status: 200 len: 1490 microversion: 2.1 time: 0.568263 Nov 28 14:11:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 267/807] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:11:00 2023] GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3 => generated 1490 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:11:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee48951-d5c7-4d89-ab05-766bbaf2edc3", "name": "network-vif-deleted", "tag": "8df9d722-c1e7-4a3f-9631-ebf0acff9425"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] Creating event network-vif-deleted:8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 on user Nov 28 14:11:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150272 Nov 28 14:11:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 272/808] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:11:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee48951-d5c7-4d89-ab05-766bbaf2edc3", "name": "network-vif-plugged", "status": "completed", "tag": "8df9d722-c1e7-4a3f-9631-ebf0acff9425"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Creating event network-vif-plugged:8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 on user Nov 28 14:11:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032055 Nov 28 14:11:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 270/809] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] HTTP exception thrown: Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 could not be found. Nov 28 14:11:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Returning 404 to user: Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:11:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0aa2a51f-b0fe-415d-a6e3-3b17c7e0d210 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5" status: 404 len: 111 microversion: 2.1 time: 0.044991 Nov 28 14:11:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 268/810] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:11:06 2023] GET /compute/v2.1/servers/bed61555-342d-46bc-95c6-4f94b8c5bbe5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:11:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-24196e44-2c72-4862-a7c8-4ffb1d950df2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Calling method '.version_select at 0x7fedf0414820>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-24196e44-2c72-4862-a7c8-4ffb1d950df2 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951635767" status: 202 len: 0 microversion: 2.1 time: 0.022037 Nov 28 14:11:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 273/811] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:11:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951635767 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=14 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-05787add-777a-468e-bac5-498dc9b437fc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065866 Nov 28 14:11:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 271/812] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 14:11:28 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:29 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:11:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 204 len: 0 microversion: 2.20 time: 0.151637 Nov 28 14:11:29 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 269/813] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:11:29 2023] DELETE /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-unplugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Creating event network-vif-unplugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:11:29 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:29 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-55905086-87e3-41c2-ada7-e179faf77d5e tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 200 len: 1708 microversion: 2.20 time: 0.250893 Nov 28 14:11:29 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 274/814] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:11:29 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:11:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028822 Nov 28 14:11:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 272/815] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:31 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-deleted", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:31 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] Creating event network-vif-deleted:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:11:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056896 Nov 28 14:11:31 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 270/816] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:31 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140e1e3c-a452-44b9-86d3-0e6232512665", "name": "network-vif-plugged", "status": "completed", "tag": "d02ad480-f01f-442a-a00e-7dca16a27d3d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:31 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:31 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:31 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:31 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Creating event network-vif-plugged:d02ad480-f01f-442a-a00e-7dca16a27d3d for instance 140e1e3c-a452-44b9-86d3-0e6232512665 on user Nov 28 14:11:31 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034282 Nov 28 14:11:31 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 275/817] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:35 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'services' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:11:35 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments/38b03b35-b011-46d4-ab6f-2bd994f14c47" status: 202 len: 0 microversion: 2.1 time: 0.223958 Nov 28 14:11:35 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 273/818] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:11:35 2023] DELETE /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments/38b03b35-b011-46d4-ab6f-2bd994f14c47 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:35 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:35 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d48c8e62-ed42-4ce5-a1ee-404f7817dfb0 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052730 Nov 28 14:11:35 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 271/819] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:11:35 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:36 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-abf23225-fd03-4eb5-9698-af432ef17d78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1769 microversion: 2.87 time: 0.297605 Nov 28 14:11:36 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 276/820] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:11:36 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1769 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] HTTP exception thrown: Instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 could not be found. Nov 28 14:11:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Returning 404 to user: Instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:11:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b2cfae24-1ad2-49c2-8462-eaa3fd86a5d2 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3" status: 404 len: 111 microversion: 2.1 time: 0.205116 Nov 28 14:11:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 274/821] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:11:51 2023] GET /compute/v2.1/servers/9ee48951-d5c7-4d89-ab05-766bbaf2edc3 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:11:58 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 204 len: 0 microversion: 2.1 time: 0.137118 Nov 28 14:11:58 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 272/822] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:11:58 2023] DELETE /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=14 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea60b55-d974-4262-9413-37459394f8a6", "name": "network-vif-unplugged", "status": "completed", "tag": "8b8020db-6358-4061-8494-c21f704791fb"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:11:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:11:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:11:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:11:59 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:11:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9abcdb15-9436-4fa7-a33b-9f6a667674fd tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 200 len: 1538 microversion: 2.1 time: 0.388822 Nov 28 14:11:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 277/823] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:11:58 2023] GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 1538 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:11:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Creating event network-vif-unplugged:8b8020db-6358-4061-8494-c21f704791fb for instance 8ea60b55-d974-4262-9413-37459394f8a6 on user Nov 28 14:11:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047965 Nov 28 14:11:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 275/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:11:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea60b55-d974-4262-9413-37459394f8a6", "name": "network-vif-plugged", "status": "completed", "tag": "8b8020db-6358-4061-8494-c21f704791fb"}, {"server_uuid": "8ea60b55-d974-4262-9413-37459394f8a6", "name": "network-vif-deleted", "tag": "8b8020db-6358-4061-8494-c21f704791fb"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Creating event network-vif-plugged:8b8020db-6358-4061-8494-c21f704791fb for instance 8ea60b55-d974-4262-9413-37459394f8a6 on user Nov 28 14:12:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Creating event network-vif-deleted:8b8020db-6358-4061-8494-c21f704791fb for instance 8ea60b55-d974-4262-9413-37459394f8a6 on user Nov 28 14:12:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032597 Nov 28 14:12:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 273/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HTTP exception thrown: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. Nov 28 14:12:19 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Returning 404 to user: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:12:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-fa60cd74-f5c5-47e2-924c-f607ee5cc26b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 404 len: 111 microversion: 2.20 time: 0.041126 Nov 28 14:12:19 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 278/826] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:12:19 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:12:19 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:19 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:19 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-1687a6d1-b092-46df-b309-d58ac0c27cf9 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '.version_select at 0x7fedf015a3b0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-1687a6d1-b092-46df-b309-d58ac0c27cf9 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276374203" status: 204 len: 0 microversion: 2.20 time: 0.042003 Nov 28 14:12:19 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 276/827] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 14:12:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276374203 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:12:20 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:20 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1581c897-b10a-4a3e-84a2-e72d8aae3412 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'create', calling method: .version_select at 0x7fedf021eb90>, body: {"keypair": {"name": "tempest-keypair-1146512233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASV6MnUadFAc7iZ7kDsGBeSWBHLx0HiC7FZU6gHt0T9M0U7bXyxZrHTWGaqZr8IRdsSIm5ml9TZaH+JYHyWlY0s7Lsr7RMw0ZMqU1z4TcvE8WrXdZcF+eGNoZGvUAnKNg=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:20 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-1581c897-b10a-4a3e-84a2-e72d8aae3412 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:12:20 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-1581c897-b10a-4a3e-84a2-e72d8aae3412 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for user e8074110936b461690a6518ddee180ac and project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:12:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1581c897-b10a-4a3e-84a2-e72d8aae3412 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.062998 Nov 28 14:12:20 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 274/828] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 14:12:20 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-305119202", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "97080b5a-fd19-4a16-bc96-21d386fe3782"}], "security_groups": [{"name": "tempest-securitygroup--1576028813"}], "key_name": "tempest-keypair-1146512233", "user_data": "}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] validate_networks() for [('97080b5a-fd19-4a16-bc96-21d386fe3782', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting quotas for user e8074110936b461690a6518ddee180ac and project bb60c747fc434b8a8bb9a0df65970d92. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:12:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:12:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.700412 Nov 28 14:12:22 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 279/829] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:12:22 2023] POST /compute/v2.1/servers => generated 400 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:12:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-898aba80-5f61-4780-a985-f63a52eb3224 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:22 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-898aba80-5f61-4780-a985-f63a52eb3224 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:22 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-898aba80-5f61-4780-a985-f63a52eb3224 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:23 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-898aba80-5f61-4780-a985-f63a52eb3224 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:23 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-898aba80-5f61-4780-a985-f63a52eb3224 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-898aba80-5f61-4780-a985-f63a52eb3224 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1273 microversion: 2.20 time: 0.099591 Nov 28 14:12:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 277/830] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:12:22 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Creating event network-changed:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:12:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032879 Nov 28 14:12:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 275/831] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f46897bf-8cf6-42d1-99c4-556221aac8ad tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065516 Nov 28 14:12:25 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 280/832] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:12:25 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:25 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:12:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 204 len: 0 microversion: 2.1 time: 0.125069 Nov 28 14:12:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 278/833] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:12:25 2023] DELETE /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:25 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:26 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-974b16aa-aa22-498b-b761-6e3f556e8d09 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 200 len: 1687 microversion: 2.1 time: 0.439105 Nov 28 14:12:26 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 276/834] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:12:25 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 1687 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:12:27 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-unplugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}, {"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}, {"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}, {"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Creating event network-vif-unplugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.031768 Nov 28 14:12:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 281/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:12:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046867 Nov 28 14:12:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 279/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:29 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-unplugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}, {"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-plugged", "status": "completed", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}, {"server_uuid": "62c8d241-26ff-431e-98de-56c2941cf895", "name": "network-vif-deleted", "tag": "90875e2b-ad20-4e71-903c-08ab27b78d96"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Creating event network-vif-unplugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Creating event network-vif-plugged:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Creating event network-vif-deleted:90875e2b-ad20-4e71-903c-08ab27b78d96 for instance 62c8d241-26ff-431e-98de-56c2941cf895 on user Nov 28 14:12:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035395 Nov 28 14:12:29 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 277/837] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:29 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:12:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032956 Nov 28 14:12:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 282/838] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1310594149", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] validate_networks() for None {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Getting quotas for project d08f31bef3a34d76b4d792b4f57841ac. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Getting quotas for user d0e78e1f355b413d821a1d11223911d8 and project d08f31bef3a34d76b4d792b4f57841ac. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:12:32 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:12:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.454394 Nov 28 14:12:32 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 280/839] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:12:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:12:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e4cac0f0-5217-4567-9c63-433943fd5c31 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e4cac0f0-5217-4567-9c63-433943fd5c31 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:32 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e4cac0f0-5217-4567-9c63-433943fd5c31 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e78e1f355b413d821a1d11223911d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f31bef3a34d76b4d792b4f57841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e4cac0f0-5217-4567-9c63-433943fd5c31 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c" status: 200 len: 1207 microversion: 2.1 time: 0.069087 Nov 28 14:12:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 278/840] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:12:32 2023] GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c => generated 1207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:12:35 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:35 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b829120-ebe1-42d0-8875-e580f38b397c", "tag": "a99acb2d-6700-4f26-be76-21e54b5d700d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Creating event network-changed:a99acb2d-6700-4f26-be76-21e54b5d700d for instance 5b829120-ebe1-42d0-8875-e580f38b397c on user Nov 28 14:12:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040538 Nov 28 14:12:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 283/841] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:36 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1916015322", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "3bfd3351-2c37-456a-b7b8-e306bd80afb4"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:36 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] validate_networks() for [('3bfd3351-2c37-456a-b7b8-e306bd80afb4', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:12:37 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b829120-ebe1-42d0-8875-e580f38b397c", "name": "network-vif-plugged", "status": "completed", "tag": "a99acb2d-6700-4f26-be76-21e54b5d700d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:37 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Creating event network-vif-plugged:a99acb2d-6700-4f26-be76-21e54b5d700d for instance 5b829120-ebe1-42d0-8875-e580f38b397c on user Nov 28 14:12:37 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042607 Nov 28 14:12:37 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 279/842] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for user f88c92554f0f44b0be661aa40aec8670 and project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:12:37 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:12:37 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.991578 Nov 28 14:12:37 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 281/843] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:12:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:12:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b5b40e6a-b41b-4113-8a69-27558c28c4fd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:37 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b5b40e6a-b41b-4113-8a69-27558c28c4fd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:37 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-b5b40e6a-b41b-4113-8a69-27558c28c4fd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:37 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-b5b40e6a-b41b-4113-8a69-27558c28c4fd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:37 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-b5b40e6a-b41b-4113-8a69-27558c28c4fd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:12:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b5b40e6a-b41b-4113-8a69-27558c28c4fd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" status: 200 len: 1395 microversion: 2.87 time: 0.067783 Nov 28 14:12:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 284/844] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:12:37 2023] GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 => generated 1395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:12:39 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b829120-ebe1-42d0-8875-e580f38b397c", "name": "network-vif-plugged", "status": "completed", "tag": "a99acb2d-6700-4f26-be76-21e54b5d700d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Creating event network-vif-plugged:a99acb2d-6700-4f26-be76-21e54b5d700d for instance 5b829120-ebe1-42d0-8875-e580f38b397c on user Nov 28 14:12:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 Nov 28 14:12:39 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 280/845] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0", "tag": "54df673e-4fe7-4894-b18f-ed5dc483d516"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Creating event network-changed:54df673e-4fe7-4894-b18f-ed5dc483d516 for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 on user Nov 28 14:12:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030494 Nov 28 14:12:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 282/846] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0", "name": "network-vif-plugged", "status": "completed", "tag": "54df673e-4fe7-4894-b18f-ed5dc483d516"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Creating event network-vif-plugged:54df673e-4fe7-4894-b18f-ed5dc483d516 for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 on user Nov 28 14:12:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Nov 28 14:12:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 285/847] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0", "name": "network-vif-plugged", "status": "completed", "tag": "54df673e-4fe7-4894-b18f-ed5dc483d516"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:12:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Creating event network-vif-plugged:54df673e-4fe7-4894-b18f-ed5dc483d516 for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 on user Nov 28 14:12:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035189 Nov 28 14:12:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 281/848] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:12:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=14 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:12:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] HTTP exception thrown: Instance 8ea60b55-d974-4262-9413-37459394f8a6 could not be found. Nov 28 14:12:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Returning 404 to user: Instance 8ea60b55-d974-4262-9413-37459394f8a6 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:12:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7cd36c06-c83c-4400-9a57-0c2481b59542 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6" status: 404 len: 111 microversion: 2.1 time: 0.049796 Nov 28 14:12:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 283/849] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:12:49 2023] GET /compute/v2.1/servers/8ea60b55-d974-4262-9413-37459394f8a6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:12:49 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:12:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f34b98c2-be1a-48ee-9042-b922d7cb12af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Calling method '.version_select at 0x7fedf0499a20>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:12:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f34b98c2-be1a-48ee-9042-b922d7cb12af tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-61460895" status: 202 len: 0 microversion: 2.1 time: 0.030392 Nov 28 14:12:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 286/850] 10.0.0.210 () {62 vars in 1343 bytes} [Tue Nov 28 14:12:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-61460895 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=16 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:13 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-6cd0ad32-cf5f-4da1-a489-f8b8f9f125bc tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1585 microversion: 2.20 time: 0.279796 Nov 28 14:13:13 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 282/851] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:13:13 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1585 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HTTP exception thrown: Instance 62c8d241-26ff-431e-98de-56c2941cf895 could not be found. Nov 28 14:13:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Returning 404 to user: Instance 62c8d241-26ff-431e-98de-56c2941cf895 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:13:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-875694eb-c03b-4a7f-a43f-0f7660d865d1 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895" status: 404 len: 111 microversion: 2.1 time: 0.033103 Nov 28 14:13:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 284/852] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:13:16 2023] GET /compute/v2.1/servers/62c8d241-26ff-431e-98de-56c2941cf895 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:13:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=18 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0cb6d288-1a9d-495e-9b56-5d2170c3e282 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '.version_select at 0x7fedf0ae3eb0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0cb6d288-1a9d-495e-9b56-5d2170c3e282 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093862542" status: 202 len: 0 microversion: 2.1 time: 0.028737 Nov 28 14:13:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 287/853] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:13:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093862542 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:17 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f594e5e6-395a-49fb-a88e-95adb61a1555 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1659 microversion: 2.1 time: 0.210319 Nov 28 14:13:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 283/854] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:13:17 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1659 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:17 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b3972b02-b976-40fa-b066-b288bf7d4b6f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1659 microversion: 2.1 time: 0.237525 Nov 28 14:13:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 285/855] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:13:17 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1659 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:17 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-927ac9c6-3114-4ef9-82e6-c24039dda525 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1659 microversion: 2.1 time: 0.154510 Nov 28 14:13:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 288/856] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:13:17 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1659 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:22 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e78e1f355b413d821a1d11223911d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f31bef3a34d76b4d792b4f57841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-53cd80ea-1f52-4090-baab-277e3a75a46f tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c" status: 200 len: 1453 microversion: 2.1 time: 0.211377 Nov 28 14:13:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 284/857] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:13:22 2023] GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:13:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-98bd4d7a-bef2-4f56-8523-e80cfa574785 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" status: 200 len: 1692 microversion: 2.87 time: 0.238472 Nov 28 14:13:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 286/858] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:13:28 2023] GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-70a3713c-4039-4828-8f2b-835a27d7f686 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.147494 Nov 28 14:14:13 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 289/859] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 14:14:13 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-interface => generated 283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:14:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:14 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:14:14 user devstack@n-api.service[65026]: Tue Nov 28 14:14:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 14:14:14 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:14 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=18 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Creating event network-changed:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048404 Nov 28 14:14:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 285/860] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c2fa8719-f879-4c2b-a95f-cf91bfe820ee tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/ips" status: 200 len: 110 microversion: 2.20 time: 0.041417 Nov 28 14:14:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 287/861] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 14:14:14 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/ips => generated 110 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:17 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'flavor' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:14:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/action" status: 202 len: 0 microversion: 2.20 time: 0.891848 Nov 28 14:14:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 290/862] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:14:17 2023] POST /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:18 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a34257c7-a7d3-434e-86bd-0ffc53ced034 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1709 microversion: 2.20 time: 0.193679 Nov 28 14:14:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 286/863] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:14:18 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:14:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-unplugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Creating event network-vif-unplugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027541 Nov 28 14:14:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 288/864] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}, {"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}, {"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}, {"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-unplugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}, {"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Creating event network-vif-unplugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.056799 Nov 28 14:14:20 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 291/865] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:20 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1596818341", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "adaa1566-e3ce-4ef9-bb92-0934c59e030e"}], "security_groups": [{"name": "tempest-securitygroup--730247831"}], "key_name": "tempest-keypair-1318751346", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ffa8b858-5204-4333-a839-2d585c38b878", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:22 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] validate_networks() for [('adaa1566-e3ce-4ef9-bb92-0934c59e030e', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:14:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c" status: 204 len: 0 microversion: 2.1 time: 0.122070 Nov 28 14:14:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 289/866] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:14:22 2023] DELETE /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Creating event network-changed:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:14:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037598 Nov 28 14:14:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 290/867] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b829120-ebe1-42d0-8875-e580f38b397c", "name": "network-vif-unplugged", "status": "completed", "tag": "a99acb2d-6700-4f26-be76-21e54b5d700d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Creating event network-vif-unplugged:a99acb2d-6700-4f26-be76-21e54b5d700d for instance 5b829120-ebe1-42d0-8875-e580f38b397c on user Nov 28 14:14:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030575 Nov 28 14:14:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 291/868] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:23 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e78e1f355b413d821a1d11223911d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f31bef3a34d76b4d792b4f57841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9ff744ba-71f1-4fc0-a887-1235ed66b488 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c" status: 200 len: 1459 microversion: 2.1 time: 0.352580 Nov 28 14:14:23 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 292/869] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:14:23 2023] GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c => generated 1459 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:14:23 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ffa8b858-5204-4333-a839-2d585c38b878',volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:14:24 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.200300 Nov 28 14:14:24 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 287/870] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:14:22 2023] POST /compute/v2.1/servers => generated 403 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:14:24 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-64bea482-8887-4d65-b2a5-93c36648f089 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:24 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-64bea482-8887-4d65-b2a5-93c36648f089 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:24 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-64bea482-8887-4d65-b2a5-93c36648f089 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:24 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-64bea482-8887-4d65-b2a5-93c36648f089 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1076 microversion: 2.1 time: 0.073684 Nov 28 14:14:24 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 292/871] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:14:24 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1076 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:14:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b829120-ebe1-42d0-8875-e580f38b397c", "name": "network-vif-plugged", "status": "completed", "tag": "a99acb2d-6700-4f26-be76-21e54b5d700d"}, {"server_uuid": "5b829120-ebe1-42d0-8875-e580f38b397c", "name": "network-vif-deleted", "tag": "a99acb2d-6700-4f26-be76-21e54b5d700d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Creating event network-vif-plugged:a99acb2d-6700-4f26-be76-21e54b5d700d for instance 5b829120-ebe1-42d0-8875-e580f38b397c on user Nov 28 14:14:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Creating event network-vif-deleted:a99acb2d-6700-4f26-be76-21e54b5d700d for instance 5b829120-ebe1-42d0-8875-e580f38b397c on user Nov 28 14:14:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038036 Nov 28 14:14:25 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 293/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Creating event network-changed:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:14:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Nov 28 14:14:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 288/873] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-974993513"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/action" status: 202 len: 52 microversion: 2.87 time: 0.806214 Nov 28 14:14:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 293/874] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:14:28 2023] POST /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/action => generated 52 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:35 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:14:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8d478623-34df-4bf9-8594-6fa09358183b tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" status: 200 len: 1692 microversion: 2.87 time: 0.243136 Nov 28 14:14:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 294/875] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:14:35 2023] GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 => generated 1692 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:14:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Creating event network-vif-plugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:14:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222732 Nov 28 14:14:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 289/876] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:14:38 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:38 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:14:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:14:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:14:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:14:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:14:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Creating event network-vif-plugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:14:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043647 Nov 28 14:14:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 294/877] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=14 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:08 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:08 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-eda14045-3810-4ba8-8ad8-def620985ec4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1650 microversion: 2.20 time: 0.222105 Nov 28 14:15:08 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 295/878] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:15:08 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1650 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=14 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] HTTP exception thrown: Instance 5b829120-ebe1-42d0-8875-e580f38b397c could not be found. Nov 28 14:15:13 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Returning 404 to user: Instance 5b829120-ebe1-42d0-8875-e580f38b397c could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:15:13 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4afea830-0f20-4426-b35e-3b6414761df7 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c" status: 404 len: 111 microversion: 2.1 time: 0.033673 Nov 28 14:15:13 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 290/879] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:15:13 2023] GET /compute/v2.1/servers/5b829120-ebe1-42d0-8875-e580f38b397c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:14 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-bea370b5-7799-4693-9c45-4a52c5d9d45c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1430 microversion: 2.1 time: 0.203473 Nov 28 14:15:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 295/880] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:15:14 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1430 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:15:35 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:35 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2115577482", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "destination_type": "volume"}], "networks": [{"uuid": "3bfd3351-2c37-456a-b7b8-e306bd80afb4"}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] validate_networks() for [('3bfd3351-2c37-456a-b7b8-e306bd80afb4', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting quotas for user f88c92554f0f44b0be661aa40aec8670 and project 3de3b398da714d8cb92fad7f64d5c64e. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:15:36 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:15:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.785486 Nov 28 14:15:36 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 296/881] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 14:15:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1c25d263-7168-4cad-8dc5-d3f8a2152870 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1c25d263-7168-4cad-8dc5-d3f8a2152870 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-1c25d263-7168-4cad-8dc5-d3f8a2152870 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-1c25d263-7168-4cad-8dc5-d3f8a2152870 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:36 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-1c25d263-7168-4cad-8dc5-d3f8a2152870 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:15:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1c25d263-7168-4cad-8dc5-d3f8a2152870 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1395 microversion: 2.87 time: 0.088653 Nov 28 14:15:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 291/882] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:15:36 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1395 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:15:38 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 14:15:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:15:38 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:38 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Creating event network-changed:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:15:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Nov 28 14:15:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 296/883] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:15:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:15:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039793 Nov 28 14:15:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 297/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:15:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:15:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:15:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:15:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:15:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:15:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:15:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:15:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040082 Nov 28 14:15:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 292/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:15:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:08 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36220. Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9befdeba-ff39-41f5-bbd5-8b7bb1b69672"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-07f50353-e5b3-4b2b-a160-abd1bdb373cd tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.643449 Nov 28 14:16:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 297/886] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 14:16:08 2023] POST /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-volume_attachments => generated 188 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8689501e-071c-41f1-9aef-bb5abeba2e19 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-volume_attachments/9befdeba-ff39-41f5-bbd5-8b7bb1b69672" status: 202 len: 0 microversion: 2.20 time: 0.285006 Nov 28 14:16:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 298/887] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 14:16:09 2023] DELETE /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-volume_attachments/9befdeba-ff39-41f5-bbd5-8b7bb1b69672 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:10 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65026) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 14:16:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/action" status: 202 len: 0 microversion: 2.20 time: 0.300741 Nov 28 14:16:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 293/888] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:16:09 2023] POST /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:10 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8444ff3d-1c26-42b0-ad18-f9a1b82fe7d7 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1658 microversion: 2.20 time: 0.199667 Nov 28 14:16:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 298/889] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:16:10 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1658 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:16:12 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:12 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:12 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Creating event network-changed:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:16:12 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156785 Nov 28 14:16:12 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 299/890] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:14 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:14 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e5aa6653-803a-47e6-8010-b2fb5b1ddc08 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.147036 Nov 28 14:16:14 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 294/891] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:16:14 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/os-interface => generated 282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Creating event network-changed:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:16:15 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093563 Nov 28 14:16:15 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 299/892] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:15 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:15 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4e0120f8-3fde-4185-af45-f036ec15a9a4 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1430 microversion: 2.1 time: 0.157514 Nov 28 14:16:15 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 300/893] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:16:15 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1430 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:15 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Old instance type m1.tiny, new instance type m1.small {{(pid=65026) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting quotas for user 9f84ee8a311d4619b7d51c2066d4775f and project 82ab030af40f43e28b5f1b7ce64c50a8. Resources: {'cores', 'ram'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:16:16 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:16:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/action" status: 202 len: 0 microversion: 2.1 time: 0.323488 Nov 28 14:16:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 295/894] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:16:15 2023] POST /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:16 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-282e9fc9-ae63-469c-b455-2d9098c117fb tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1439 microversion: 2.1 time: 0.283160 Nov 28 14:16:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 300/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:16:16 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1439 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 14:16:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Creating event network-changed:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:16:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Nov 28 14:16:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 301/896] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:19 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-unplugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Creating event network-vif-unplugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:16:19 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65026) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 14:16:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043601 Nov 28 14:16:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 296/897] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:19 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:16:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055395 Nov 28 14:16:19 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 301/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Creating event network-vif-plugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:16:21 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65025) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 14:16:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Nov 28 14:16:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 302/899] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:21 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:21 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:21 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:16:21 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Nov 28 14:16:21 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 297/900] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:26 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:16:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-190e6fe5-7ff7-4e95-b80e-a3eb0a8d5e08 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1770 microversion: 2.87 time: 0.249507 Nov 28 14:16:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 302/901] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:16:26 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1770 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=12 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Creating event network-vif-plugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:16:32 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65025) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 14:16:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047116 Nov 28 14:16:32 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:16:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Creating event network-vif-plugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:16:34 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65026) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 14:16:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050002 Nov 28 14:16:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 298/903] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:16:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=14 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:00 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:00 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-049ccccb-2ed1-47f9-a336-5b06d19486d5 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1703 microversion: 2.20 time: 0.199572 Nov 28 14:17:00 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 303/904] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:17:00 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1703 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:06 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b933db00-e498-4d3e-b730-e48b63f7c0dc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1557 microversion: 2.1 time: 0.232907 Nov 28 14:17:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 304/905] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:17:06 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "26883cef-55e4-4f8a-92e7-deea8797fb37"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:27 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'flavor' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:17:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/action" status: 200 len: 29 microversion: 2.87 time: 0.626832 Nov 28 14:17:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 299/906] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:17:27 2023] POST /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/action => generated 29 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:17:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a49ebddf-16c1-44c6-ab86-4c6bc152bd47 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1776 microversion: 2.87 time: 0.355423 Nov 28 14:17:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 304/907] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:17:27 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1776 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:17:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-unplugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:17:28 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:28 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:17:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Creating event network-vif-unplugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:17:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038972 Nov 28 14:17:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 305/908] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:17:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:17:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:17:30 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044465 Nov 28 14:17:30 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 300/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:17:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:17:33 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:17:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:17:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030960 Nov 28 14:17:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 305/910] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:17:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:17:35 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:17:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:17:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:17:35 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:17:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:17:35 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Nov 28 14:17:35 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 306/911] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:17:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-60dc8813-ec2a-4fcb-b951-f6475ea998d6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054542 Nov 28 14:18:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 301/912] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 14:18:00 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:18:00 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:01 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:18:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 204 len: 0 microversion: 2.20 time: 0.122671 Nov 28 14:18:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 306/913] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:18:00 2023] DELETE /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-unplugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:18:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Creating event network-vif-unplugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036156 Nov 28 14:18:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 302/914] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:01 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:01 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-791a6490-17a5-4ed3-9142-5f4204f86b21 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 200 len: 1709 microversion: 2.20 time: 0.267628 Nov 28 14:18:01 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 307/915] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:18:01 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 1709 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 14:18:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-plugged", "status": "completed", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}, {"server_uuid": "ab749a19-fc12-4a97-9a7d-7a5410b2038d", "name": "network-vif-deleted", "tag": "083dcc40-7aec-41be-81b9-aaad0c58aa1f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:18:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Creating event network-vif-plugged:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:18:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Creating event network-vif-deleted:083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d on user Nov 28 14:18:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033116 Nov 28 14:18:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 307/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:18:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:07 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/action" status: 204 len: 0 microversion: 2.1 time: 0.068512 Nov 28 14:18:07 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 303/917] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:18:06 2023] POST /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:07 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-cd71e619-9b82-459f-ba0d-26692ff71a2b tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1557 microversion: 2.1 time: 0.261466 Nov 28 14:18:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 308/918] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:18:07 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1557 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:18 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-6f0575cc-f770-47fb-8774-882d41f2b0be tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1756 microversion: 2.87 time: 0.287513 Nov 28 14:18:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 308/919] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:18:18 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HTTP exception thrown: Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d could not be found. Nov 28 14:18:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Returning 404 to user: Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:18:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0d8c0551-3797-41c7-ad55-c65469fb4432 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 404 len: 111 microversion: 2.20 time: 0.049836 Nov 28 14:18:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 304/920] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:18:51 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:18:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8d63c24c-f40c-4cd5-95c0-bab67dd7b54b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '.version_select at 0x7fedf04991b0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=12 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8d63c24c-f40c-4cd5-95c0-bab67dd7b54b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146512233" status: 204 len: 0 microversion: 2.20 time: 0.031277 Nov 28 14:18:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 309/921] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 14:18:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146512233 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HTTP exception thrown: Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d could not be found. Nov 28 14:18:55 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Returning 404 to user: Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:18:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3c2ea829-3a5f-4101-87c2-c08812c4aaf6 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 404 len: 111 microversion: 2.20 time: 0.031827 Nov 28 14:18:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 309/922] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:18:55 2023] DELETE /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HTTP exception thrown: Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d could not be found. Nov 28 14:18:55 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Returning 404 to user: Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:18:55 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5dbd30e6-5906-4344-be11-c6873e83cf8a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d" status: 404 len: 111 microversion: 2.20 time: 0.026224 Nov 28 14:18:55 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 305/923] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:18:55 2023] GET /compute/v2.1/servers/ab749a19-fc12-4a97-9a7d-7a5410b2038d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:57 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:18:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f0e0ea89-212e-44a5-aff8-ffbfd3cb6903 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1549 microversion: 2.1 time: 0.229191 Nov 28 14:18:57 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 310/924] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:18:57 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HTTP exception thrown: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. Nov 28 14:18:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Returning 404 to user: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:18:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9150b583-e5c5-4d5d-adb6-909328b84d87 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 404 len: 111 microversion: 2.20 time: 0.032718 Nov 28 14:18:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 310/925] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:18:59 2023] DELETE /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:18:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HTTP exception thrown: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. Nov 28 14:18:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Returning 404 to user: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:18:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a19370d0-8f27-41fd-9f6e-c84cc588bcc4 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 10.0.0.210 "GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665" status: 404 len: 111 microversion: 2.20 time: 0.029909 Nov 28 14:18:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 306/926] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:18:59 2023] GET /compute/v2.1/servers/140e1e3c-a452-44b9-86d3-0e6232512665 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/action" status: 202 len: 0 microversion: 2.87 time: 0.075431 Nov 28 14:19:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 311/927] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 14:19:18 2023] POST /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:19 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:19:19 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:19:19 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:19:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b6e7ed76-ed4b-4f07-9768-9353c0e3be17 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1764 microversion: 2.87 time: 0.336668 Nov 28 14:19:19 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 311/928] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:19:18 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1764 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:19:19 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-unplugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:19:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Creating event network-vif-unplugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:19:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035155 Nov 28 14:19:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 307/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:19:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:19:21 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:19:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:21 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:19:21 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030567 Nov 28 14:19:21 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 312/930] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:19:23 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}, {"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:19:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:23 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:19:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:19:23 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048368 Nov 28 14:19:23 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 312/931] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:19:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:58 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:19:58 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-93849660-23a0-4ee1-b9ca-671c8916f4b7 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1549 microversion: 2.1 time: 0.390661 Nov 28 14:19:58 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 308/932] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:19:57 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1549 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/action" status: 200 len: 32071 microversion: 2.1 time: 0.245565 Nov 28 14:19:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 313/933] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:19:58 2023] POST /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a/action => generated 32071 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:19:58 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:19:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-5368f055-0223-4a25-8b60-dbca149164f5 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1540 microversion: 2.1 time: 0.204673 Nov 28 14:19:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 313/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:19:58 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1540 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:20:09 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:20:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-37ed21e8-5f12-411a-9b93-14df5ef01a45 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1770 microversion: 2.87 time: 0.234396 Nov 28 14:20:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 309/935] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:20:09 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1770 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:58 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:20:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 204 len: 0 microversion: 2.1 time: 0.117162 Nov 28 14:20:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 314/936] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:20:58 2023] DELETE /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:59 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:20:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0c548e72-a5da-40a1-9cb0-1cdf2edae317 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 200 len: 1555 microversion: 2.1 time: 0.216074 Nov 28 14:20:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 314/937] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:20:58 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:20:59 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:59 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:20:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-unplugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:20:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:20:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:20:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:20:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Creating event network-vif-unplugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:20:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.250132 Nov 28 14:20:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 310/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:20:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-deleted", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] Creating event network-vif-deleted:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:21:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030834 Nov 28 14:21:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 315/939] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:01 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9d0178-d8cd-4d99-930f-7d2f787e899a", "name": "network-vif-plugged", "status": "completed", "tag": "8ffe4343-b471-4fba-bd3b-676b3653941d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Creating event network-vif-plugged:8ffe4343-b471-4fba-bd3b-676b3653941d for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a on user Nov 28 14:21:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028513 Nov 28 14:21:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 315/940] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:21:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 204 len: 0 microversion: 2.87 time: 0.249043 Nov 28 14:21:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 311/941] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:21:09 2023] DELETE /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:09 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-unplugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Creating event network-vif-unplugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:21:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036838 Nov 28 14:21:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 316/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:10 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:21:10 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:21:10 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:21:10 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-5ec616af-b0dd-44f9-8c79-3959300120dd tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 200 len: 1776 microversion: 2.87 time: 0.336140 Nov 28 14:21:10 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 316/943] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:21:09 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 1776 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:21:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-deleted", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:11 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] Creating event network-vif-deleted:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:21:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034393 Nov 28 14:21:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 312/944] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:12 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e93e8e5-ec04-43bc-8c31-c03ef461cc62", "name": "network-vif-plugged", "status": "completed", "tag": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Creating event network-vif-plugged:c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 on user Nov 28 14:21:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Nov 28 14:21:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 317/945] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HTTP exception thrown: Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a could not be found. Nov 28 14:21:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Returning 404 to user: Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:21:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a3cecde8-6124-47f1-888b-4d844bddbeb3 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 404 len: 111 microversion: 2.1 time: 0.035710 Nov 28 14:21:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 317/946] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:21:49 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HTTP exception thrown: Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a could not be found. Nov 28 14:21:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Returning 404 to user: Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:21:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1036becc-ca79-4fd3-b968-ad3bddfe6966 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 404 len: 111 microversion: 2.1 time: 0.037730 Nov 28 14:21:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 313/947] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:21:49 2023] DELETE /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HTTP exception thrown: Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a could not be found. Nov 28 14:21:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Returning 404 to user: Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:21:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c215df88-8647-43c9-a041-5ac83f7de3fc tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a" status: 404 len: 111 microversion: 2.1 time: 0.036236 Nov 28 14:21:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 318/948] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:21:49 2023] GET /compute/v2.1/servers/9f9d0178-d8cd-4d99-930f-7d2f787e899a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:52 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:21:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 204 len: 0 microversion: 2.1 time: 0.108133 Nov 28 14:21:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 318/949] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:21:52 2023] DELETE /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "name": "network-vif-unplugged", "status": "completed", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Creating event network-vif-unplugged:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:21:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030480 Nov 28 14:21:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 319/950] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:52 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:21:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a6628f56-cb8d-4ea0-bd31-24528f391e1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 200 len: 1546 microversion: 2.1 time: 0.305373 Nov 28 14:21:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 314/951] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:21:52 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 1546 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:21:54 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "name": "network-vif-deleted", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] Creating event network-vif-deleted:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:21:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099511 Nov 28 14:21:54 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 319/952] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:21:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b531830d-1e76-4b07-bed1-2b009e235382", "name": "network-vif-plugged", "status": "completed", "tag": "f0bdc249-748c-4d50-82ce-ad985120d91f"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:21:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:21:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:21:55 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:21:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Creating event network-vif-plugged:f0bdc249-748c-4d50-82ce-ad985120d91f for instance b531830d-1e76-4b07-bed1-2b009e235382 on user Nov 28 14:21:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Nov 28 14:21:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 320/953] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HTTP exception thrown: Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 could not be found. Nov 28 14:22:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Returning 404 to user: Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:22:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-b5de159b-0d81-469b-abb7-1f53e2f76935 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62" status: 404 len: 111 microversion: 2.87 time: 0.031086 Nov 28 14:22:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 315/954] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:22:00 2023] GET /compute/v2.1/servers/7e93e8e5-ec04-43bc-8c31-c03ef461cc62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:00 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:22:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" status: 204 len: 0 microversion: 2.87 time: 0.104869 Nov 28 14:22:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 320/955] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:22:00 2023] DELETE /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0", "name": "network-vif-unplugged", "status": "completed", "tag": "54df673e-4fe7-4894-b18f-ed5dc483d516"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Creating event network-vif-unplugged:54df673e-4fe7-4894-b18f-ed5dc483d516 for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 on user Nov 28 14:22:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029432 Nov 28 14:22:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 316/956] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:22:01 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:01 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:01 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f51e4d90-e043-4c47-83c7-12b83b7fe467 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" status: 200 len: 1698 microversion: 2.87 time: 0.889380 Nov 28 14:22:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 321/957] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:22:00 2023] GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 => generated 1698 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:22:03 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0", "name": "network-vif-plugged", "status": "completed", "tag": "54df673e-4fe7-4894-b18f-ed5dc483d516"}, {"server_uuid": "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0", "name": "network-vif-deleted", "tag": "54df673e-4fe7-4894-b18f-ed5dc483d516"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Creating event network-vif-plugged:54df673e-4fe7-4894-b18f-ed5dc483d516 for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 on user Nov 28 14:22:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Creating event network-vif-deleted:54df673e-4fe7-4894-b18f-ed5dc483d516 for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 on user Nov 28 14:22:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032203 Nov 28 14:22:03 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 321/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:22:43 user devstack@n-api.service[65026]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=12 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HTTP exception thrown: Instance b531830d-1e76-4b07-bed1-2b009e235382 could not be found. Nov 28 14:22:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Returning 404 to user: Instance b531830d-1e76-4b07-bed1-2b009e235382 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:22:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a5457cd2-047d-4dea-a584-4a040a66c34c tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382" status: 404 len: 111 microversion: 2.1 time: 0.032553 Nov 28 14:22:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 317/959] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:22:43 2023] GET /compute/v2.1/servers/b531830d-1e76-4b07-bed1-2b009e235382 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:22:43 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-e9c4df23-b9ac-4811-a6a1-6f559697c19d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Calling method '.version_select at 0x7fedf018b520>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:43 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 14:22:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:22:43 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:22:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-e9c4df23-b9ac-4811-a6a1-6f559697c19d tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318751346" status: 202 len: 0 microversion: 2.1 time: 0.029862 Nov 28 14:22:43 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 322/960] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:22:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318751346 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HTTP exception thrown: Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 could not be found. Nov 28 14:22:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Returning 404 to user: Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:22:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6a6b43dc-5b31-4e79-96c7-add2040bf820 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" status: 404 len: 111 microversion: 2.87 time: 0.042631 Nov 28 14:22:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 322/961] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:22:51 2023] GET /compute/v2.1/servers/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:51 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40104. Nov 28 14:22:51 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:22:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 204 len: 0 microversion: 2.87 time: 0.128289 Nov 28 14:22:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 318/962] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:22:51 2023] DELETE /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:51 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40106. Nov 28 14:22:52 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:52 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:52 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b85b82ae-9d08-47f9-bbca-9a545fe933e8 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 200 len: 1775 microversion: 2.87 time: 0.306248 Nov 28 14:22:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 323/963] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:22:51 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 1775 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:22:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-unplugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Creating event network-vif-unplugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:22:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030748 Nov 28 14:22:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 323/964] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:22:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-33d7be6c-5ed6-4bb0-94ce-4e78a745c230 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Action: 'create', calling method: .version_select at 0x7fedf016d7e0>, body: {"keypair": {"name": "tempest-keypair-1086921736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNvuS2G8T5YKELo2dJZ1hzfLKF7JYYyYTzxTnjYdok9t2F2vVjtP+g2P4mF9wy0UwkcFoeeu9dEjxztEjVxbCg0v5oALXWq66oanhAu2rY/frvgB0RqoDNfiiDQAQ1dTw=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:53 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-33d7be6c-5ed6-4bb0-94ce-4e78a745c230 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting quotas for project ba09555cf7f34e3fa050dec089a4da7a. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:22:53 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-33d7be6c-5ed6-4bb0-94ce-4e78a745c230 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting quotas for user c7fff3e3f0754abc82c9d66c0fbf7527 and project ba09555cf7f34e3fa050dec089a4da7a. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:22:53 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-33d7be6c-5ed6-4bb0-94ce-4e78a745c230 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058243 Nov 28 14:22:53 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 319/965] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:22:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:22:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-plugged", "status": "completed", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}, {"server_uuid": "db5b1a94-7308-4e99-bc57-025611be1f23", "name": "network-vif-deleted", "tag": "f6df96a1-9fa2-447c-b0f6-9f53f1521839"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Creating event network-vif-plugged:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:22:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Creating event network-vif-deleted:f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance db5b1a94-7308-4e99-bc57-025611be1f23 on user Nov 28 14:22:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046135 Nov 28 14:22:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 324/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1180311090", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "5d207296-8c9c-436e-abd5-9a920c76f067"}], "security_groups": [{"name": "tempest-securitygroup--1387424763"}], "key_name": "tempest-keypair-1086921736", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] validate_networks() for [('5d207296-8c9c-436e-abd5-9a920c76f067', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting quotas for project ba09555cf7f34e3fa050dec089a4da7a. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting quotas for user c7fff3e3f0754abc82c9d66c0fbf7527 and project ba09555cf7f34e3fa050dec089a4da7a. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:22:55 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:22:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.711326 Nov 28 14:22:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 324/967] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:22:55 2023] POST /compute/v2.1/servers => generated 404 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:22:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-57ba583a-79e4-45ad-82a0-53795bf14695 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:22:56 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-57ba583a-79e4-45ad-82a0-53795bf14695 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:22:56 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-57ba583a-79e4-45ad-82a0-53795bf14695 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:22:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-57ba583a-79e4-45ad-82a0-53795bf14695 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1238 microversion: 2.1 time: 0.064218 Nov 28 14:22:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 320/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:22:56 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:22:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:22:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:22:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:22:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:22:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Creating event network-changed:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:22:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031195 Nov 28 14:22:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 325/969] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:22:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:23:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:23:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:23:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Nov 28 14:23:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 325/970] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:23:02 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:23:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:23:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038371 Nov 28 14:23:02 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 321/971] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HTTP exception thrown: Instance db5b1a94-7308-4e99-bc57-025611be1f23 could not be found. Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Returning 404 to user: Instance db5b1a94-7308-4e99-bc57-025611be1f23 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:23:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a8c24a79-3a28-42d2-a984-42ec33f9c289 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23" status: 404 len: 111 microversion: 2.87 time: 0.031770 Nov 28 14:23:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 326/972] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:23:42 2023] GET /compute/v2.1/servers/db5b1a94-7308-4e99-bc57-025611be1f23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:23:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9" status: 204 len: 0 microversion: 2.87 time: 0.118510 Nov 28 14:23:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 326/973] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 14:23:42 2023] DELETE /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839b0b0f-101d-46ca-97a8-ab404cc35ea9", "name": "network-vif-unplugged", "status": "completed", "tag": "51520e6e-9061-4b7f-8860-53b7cfa9028a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:23:42 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:23:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-2b12bc53-f5f8-4fdd-b177-7d2275521d29 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9" status: 200 len: 1696 microversion: 2.87 time: 0.244301 Nov 28 14:23:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 322/974] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:23:42 2023] GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9 => generated 1696 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 14:23:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Creating event network-vif-unplugged:51520e6e-9061-4b7f-8860-53b7cfa9028a for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 on user Nov 28 14:23:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038837 Nov 28 14:23:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 327/975] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:23:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839b0b0f-101d-46ca-97a8-ab404cc35ea9", "name": "network-vif-plugged", "status": "completed", "tag": "51520e6e-9061-4b7f-8860-53b7cfa9028a"}, {"server_uuid": "839b0b0f-101d-46ca-97a8-ab404cc35ea9", "name": "network-vif-deleted", "tag": "51520e6e-9061-4b7f-8860-53b7cfa9028a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:23:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:44 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Creating event network-vif-plugged:51520e6e-9061-4b7f-8860-53b7cfa9028a for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 on user Nov 28 14:23:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Creating event network-vif-deleted:51520e6e-9061-4b7f-8860-53b7cfa9028a for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 on user Nov 28 14:23:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031213 Nov 28 14:23:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 327/976] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:23:46 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:23:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-781decb0-ed8b-4a20-a58c-b8c9105976fd tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1551 microversion: 2.1 time: 0.197552 Nov 28 14:23:46 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 323/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:23:46 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1551 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HTTP exception thrown: Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 could not be found. Nov 28 14:24:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Returning 404 to user: Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:24:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-7c25fe1d-ef7f-44ed-96ed-3593ff59e571 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9" status: 404 len: 111 microversion: 2.87 time: 0.049038 Nov 28 14:24:32 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 328/978] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 14:24:32 2023] GET /compute/v2.1/servers/839b0b0f-101d-46ca-97a8-ab404cc35ea9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1751051532", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] validate_networks() for [('e1730cd2-e937-4650-bb09-73cc1ca30994', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for user 7ac79717e12544d39215874f9b99ccf2 and project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:24:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:24:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.615534 Nov 28 14:24:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 328/979] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:24:42 2023] POST /compute/v2.1/servers => generated 381 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:24:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1fea3c4f-9f3a-4315-833c-3a743b38dff3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:24:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-1fea3c4f-9f3a-4315-833c-3a743b38dff3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:24:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=12 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:42 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-1fea3c4f-9f3a-4315-833c-3a743b38dff3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:24:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1fea3c4f-9f3a-4315-833c-3a743b38dff3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1214 microversion: 2.1 time: 0.080509 Nov 28 14:24:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 324/980] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:24:42 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:24:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1897090922", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:24:42 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] validate_networks() for [('e1730cd2-e937-4650-bb09-73cc1ca30994', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for user 7ac79717e12544d39215874f9b99ccf2 and project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:24:43 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:24:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.614817 Nov 28 14:24:43 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 329/981] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:24:42 2023] POST /compute/v2.1/servers => generated 381 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:24:43 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6a7f29c6-c2ab-4ae4-9ba3-9477658c696a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:24:43 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6a7f29c6-c2ab-4ae4-9ba3-9477658c696a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:24:43 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-6a7f29c6-c2ab-4ae4-9ba3-9477658c696a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:24:43 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6a7f29c6-c2ab-4ae4-9ba3-9477658c696a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 200 len: 1214 microversion: 2.1 time: 0.060871 Nov 28 14:24:43 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 329/982] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:24:43 2023] GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 1214 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:24:45 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Creating event network-changed:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:24:45 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035070 Nov 28 14:24:45 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 325/983] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:24:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Creating event network-changed:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:24:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086873 Nov 28 14:24:45 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 330/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-06869506-3a16-4bc1-9baa-a9a0b287640e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.199074 Nov 28 14:24:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 330/985] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:24:46 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-interface => generated 282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1877904172"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:47 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Creating event network-changed:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:24:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031542 Nov 28 14:24:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 331/986] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:24:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:24:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.855877 Nov 28 14:24:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:48 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 326/987] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:24:47 2023] POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action => generated 0 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 14:24:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ad643b6d-1521-46e0-9535-349cd58a1af2 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '.version_select at 0x7fedf018acb0>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:24:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:24:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056644 Nov 28 14:24:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 331/988] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:24:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:24:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ad643b6d-1521-46e0-9535-349cd58a1af2 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8" status: 200 len: 1611 microversion: 2.1 time: 0.054994 Nov 28 14:24:48 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 332/989] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 14:24:48 2023] GET /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8 => generated 1611 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:24:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-plugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}, {"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-plugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Creating event network-vif-plugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:24:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Creating event network-vif-plugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:24:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030652 Nov 28 14:24:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 327/990] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:24:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:24:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:24:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:24:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:24:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:24:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:24:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Nov 28 14:24:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 332/991] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:25:33 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:25:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9da0ccc8-5db7-42d5-b19d-02e6e4e6bc04 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 200 len: 1502 microversion: 2.1 time: 0.247775 Nov 28 14:25:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 333/992] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:25:33 2023] GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:25:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=10 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ee28bfaf-e0bb-4c66-9789-48f36e8b5fea tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '.version_select at 0x7fedebf95870>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:25:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ee28bfaf-e0bb-4c66-9789-48f36e8b5fea tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8" status: 200 len: 1725 microversion: 2.1 time: 0.069860 Nov 28 14:25:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 328/993] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 14:25:38 2023] GET /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8 => generated 1725 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:25:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=10 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:25:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9e5fa4ae-656b-4257-9761-5e0268869936 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '.version_select at 0x7fedf037a560>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:25:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9e5fa4ae-656b-4257-9761-5e0268869936 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8" status: 200 len: 1725 microversion: 2.1 time: 0.058449 Nov 28 14:25:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 333/994] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 14:25:38 2023] GET /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8 => generated 1725 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:25:38 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:25:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b265a7f0-7b5b-4576-bc4d-31729be6e995 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1670 microversion: 2.1 time: 0.191451 Nov 28 14:25:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 334/995] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:25:38 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:33 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:26:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c/action" status: 200 len: 32 microversion: 2.1 time: 0.109200 Nov 28 14:26:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 329/996] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:26:33 2023] POST /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 28 14:26:34 user devstack@n-api.service[65025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:34 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:26:34 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-87090282-b3a4-4909-b091-baf09d83c8b6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 200 len: 1508 microversion: 2.1 time: 0.409286 Nov 28 14:26:34 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 334/997] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:26:34 2023] GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:26:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-unplugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:34 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:34 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Creating event network-vif-unplugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:26:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039315 Nov 28 14:26:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 335/998] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-plugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Creating event network-vif-plugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:26:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029818 Nov 28 14:26:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 330/999] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-plugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}, {"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-plugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Creating event network-vif-plugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:26:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Creating event network-vif-plugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:26:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034971 Nov 28 14:26:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 335/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:39 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:26:39 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-bc2224ea-242f-48f6-9241-8bcaf0872917 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1670 microversion: 2.1 time: 0.201988 Nov 28 14:26:39 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 336/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:26:39 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1670 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d44da527-b488-450c-8cb8-09a8e18c5bfb"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:39 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320534 Nov 28 14:26:39 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 331/1002] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:26:39 2023] POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:51 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44790. Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:51 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'flavor' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:26:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action" status: 200 len: 29 microversion: 2.1 time: 0.205664 Nov 28 14:26:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 336/1003] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:26:51 2023] POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action => generated 29 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:26:51 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:52 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:26:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f6c2c9e7-3fc7-42fe-829b-907ce535d6db tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1722 microversion: 2.1 time: 0.221889 Nov 28 14:26:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 337/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:26:51 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:26:52 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:52 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:26:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Creating event network-vif-unplugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:26:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130981 Nov 28 14:26:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 332/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:54 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:54 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:26:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Nov 28 14:26:54 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 337/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:26:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048004 Nov 28 14:26:57 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 338/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:26:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:26:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:26:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:26:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:26:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:26:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028479 Nov 28 14:26:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 333/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:27:24 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:27:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-a074883f-21cd-4922-878d-b118c4e43d39 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 200 len: 1488 microversion: 2.1 time: 0.235734 Nov 28 14:27:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 338/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:27:24 2023] GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 1488 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:27:42 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:27:42 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:27:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-679aae38-5fe7-4f32-aa3e-645410a7b484 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1702 microversion: 2.1 time: 0.287386 Nov 28 14:27:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 339/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:27:42 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1702 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:25 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:28:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a993f99f-86e0-430a-915d-68febd6da11b tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1502 microversion: 2.1 time: 0.286726 Nov 28 14:28:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 334/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:28:24 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:28:42 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:28:42 user devstack@n-api.service[65025]: Tue Nov 28 14:28:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action (ip 10.0.0.210) !!! Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.264024 Nov 28 14:28:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 339/1012] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:28:42 2023] POST /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:42 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37822. Nov 28 14:28:43 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-58d9d419-1b17-40d4-8db4-fb98eb67d63a tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171154 Nov 28 14:28:43 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 340/1013] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:28:42 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:28:43 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:28:43 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:43 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:28:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:43 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Creating event network-vif-unplugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:28:43 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031415 Nov 28 14:28:43 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 335/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:28:45 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}, {"name": "network-changed", "server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}, {"name": "network-changed", "server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}, {"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}, {"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:28:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:28:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:28:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:28:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:28:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Creating event network-changed:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:28:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Creating event network-changed:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:28:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:28:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:28:45 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 859 microversion: 2.1 time: 0.042259 Nov 28 14:28:45 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 340/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 859 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:16 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'services' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:29:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments/d44da527-b488-450c-8cb8-09a8e18c5bfb" status: 202 len: 0 microversion: 2.1 time: 0.188017 Nov 28 14:29:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 341/1016] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:29:16 2023] DELETE /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments/d44da527-b488-450c-8cb8-09a8e18c5bfb => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:29:16 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 14:29:16 user devstack@n-api.service[65026]: Tue Nov 28 14:29:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 14:29:16 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 14:29:16 user devstack@n-api.service[65026]: Tue Nov 28 14:29:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-afc6a717-c81e-4728-865c-60852d601753 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062407 Nov 28 14:29:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 336/1017] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:29:16 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:27 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:29:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/action" status: 200 len: 32 microversion: 2.1 time: 0.188914 Nov 28 14:29:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 341/1018] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:29:27 2023] POST /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:28 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:29:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8c7ab7c3-5ad2-43b2-8d41-b0eebae8410d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1508 microversion: 2.1 time: 0.219156 Nov 28 14:29:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 342/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:29:27 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:29:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-unplugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:29:28 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:28 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:29:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Creating event network-vif-unplugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:29:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040428 Nov 28 14:29:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 337/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:29:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:29:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:29:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:29:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059497 Nov 28 14:29:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 342/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:29:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}, {"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:29:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:29:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:29:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:29:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:29:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:29:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028918 Nov 28 14:29:32 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 343/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:06 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d30e6e9a-4a3f-48c2-bc7e-deb2b373dbc6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050771 Nov 28 14:30:06 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 338/1023] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:30:06 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:30:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-033ea34d-cda7-46bd-b164-eebd3c332789 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '.version_select at 0x7fedf049a8c0>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-033ea34d-cda7-46bd-b164-eebd3c332789 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8" status: 204 len: 0 microversion: 2.1 time: 0.297343 Nov 28 14:30:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 343/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:30:06 2023] DELETE /compute/v2.1/images/49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:06 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:30:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 204 len: 0 microversion: 2.1 time: 0.130781 Nov 28 14:30:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 344/1025] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:30:06 2023] DELETE /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:07 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:30:07 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7e895eed-0ba3-4388-bec7-aeeeddc827c0 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 200 len: 1676 microversion: 2.1 time: 0.232362 Nov 28 14:30:07 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 339/1026] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:30:06 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:30:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:30:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Creating event network-vif-unplugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:30:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040406 Nov 28 14:30:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 344/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:30:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:30:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-deleted", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:30:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] Creating event network-vif-deleted:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:30:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082710 Nov 28 14:30:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 345/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:30:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5aaa001-eb54-42bf-b66f-537eafd16a55"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:30:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Creating event network-vif-plugged:a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c on user Nov 28 14:30:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031888 Nov 28 14:30:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 340/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:30:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:18 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:30:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-aa5e1371-4ed8-4b34-9925-9b3c34801c55 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1488 microversion: 2.1 time: 0.267705 Nov 28 14:30:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 345/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:30:18 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1488 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:30:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] HTTP exception thrown: Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c could not be found. Nov 28 14:30:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Returning 404 to user: Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:30:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-be4e5076-9dc6-4beb-a85e-86fb9018a0d9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" status: 404 len: 111 microversion: 2.1 time: 0.038342 Nov 28 14:30:57 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 346/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:30:57 2023] GET /compute/v2.1/servers/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 14:30:57 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:57 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=14 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:30:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-1e1edf53-46b3-46ab-b892-fe75891cd02d tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Calling method '.version_select at 0x7fedebe1b130>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:30:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-1e1edf53-46b3-46ab-b892-fe75891cd02d tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086921736" status: 202 len: 0 microversion: 2.1 time: 0.032637 Nov 28 14:30:57 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 341/1032] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:30:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086921736 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:31:18 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:31:18 user devstack@n-api.service[65025]: Tue Nov 28 14:31:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e30bc8d2-13f1-46bc-9abe-1f44134cbcc8"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f while it is in vm_state rescued Nov 28 14:31:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Returning 409 to user: Cannot 'attach_volume' instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f while it is in vm_state rescued {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:31:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-71893572-b16e-4ba8-918d-e7093f017788 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056072 Nov 28 14:31:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 346/1033] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:31:18 2023] POST /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/action" status: 202 len: 0 microversion: 2.1 time: 0.081249 Nov 28 14:31:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 347/1034] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:31:18 2023] POST /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:18 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:31:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c88a74b0-3313-4025-b60b-51022389ce5e tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1496 microversion: 2.1 time: 0.349031 Nov 28 14:31:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 342/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:31:18 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1496 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:31:19 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-unplugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Creating event network-vif-unplugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:31:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037919 Nov 28 14:31:19 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 347/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:31:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:31:21 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}, {"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:21 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:31:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:31:21 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040983 Nov 28 14:31:21 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 348/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:31:23 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:31:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031706 Nov 28 14:31:23 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 343/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:31:44 user devstack@n-api.service[65025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:31:44 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:44 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:44 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c62fb9a3-4f23-4f69-a9e5-18f701e54582 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Action: 'create', calling method: .version_select at 0x7fedf02f39a0>, body: {"keypair": {"name": "tempest-TestStampPattern-840267874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:44 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-c62fb9a3-4f23-4f69-a9e5-18f701e54582 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting quotas for project a7a532227da343209095aca11e672e87. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:31:44 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-c62fb9a3-4f23-4f69-a9e5-18f701e54582 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting quotas for user 2b16a7dabefd4644b463e1a45a0b40dd and project a7a532227da343209095aca11e672e87. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:31:44 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c62fb9a3-4f23-4f69-a9e5-18f701e54582 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.327214 Nov 28 14:31:44 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 348/1039] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:31:44 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:31:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-102692577", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "key_name": "tempest-TestStampPattern-840267874", "security_groups": [{"name": "tempest-secgroup-smoke-2003695621"}], "networks": [{"uuid": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:46 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] validate_networks() for [('21c4f328-f0be-4825-8ebf-c2ba4b011ed0', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting quotas for project a7a532227da343209095aca11e672e87. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting quotas for user 2b16a7dabefd4644b463e1a45a0b40dd and project a7a532227da343209095aca11e672e87. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:31:47 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:31:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.734965 Nov 28 14:31:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 349/1040] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:31:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:31:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:31:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-03edba75-77cb-4cc1-adf0-c546028ee2d8 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:31:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-03edba75-77cb-4cc1-adf0-c546028ee2d8 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:31:47 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-03edba75-77cb-4cc1-adf0-c546028ee2d8 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:31:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-03edba75-77cb-4cc1-adf0-c546028ee2d8 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd" status: 200 len: 1233 microversion: 2.1 time: 0.071778 Nov 28 14:31:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 344/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:31:47 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd => generated 1233 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:31:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:50 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40214. Nov 28 14:31:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Creating event network-changed:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:31:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034811 Nov 28 14:31:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 349/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:31:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:31:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-plugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Creating event network-vif-plugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:31:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050348 Nov 28 14:31:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 350/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:31:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:31:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-plugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:31:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:31:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:31:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:31:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Creating event network-vif-plugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:31:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Nov 28 14:31:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 345/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:31:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:32:09 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:32:09 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0bc0d647-cc27-4867-872e-f8cac9168548 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1502 microversion: 2.1 time: 0.263315 Nov 28 14:32:09 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 350/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:32:09 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:32:37 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:32:37 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-984ea640-b83a-4f46-a926-be235c0272db tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd" status: 200 len: 1535 microversion: 2.1 time: 0.224709 Nov 28 14:32:37 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 351/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:32:37 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd => generated 1535 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:33:11 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:11 user devstack@n-api.service[65026]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:33:11 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:11 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:11 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c7293696-1f00-4ccc-9b53-65c095ad2231 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'create', calling method: .version_select at 0x7fedebf94700>, body: {"keypair": {"name": "tempest-keypair-1935967308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0y2cqY3F/6K6W4DPXhIl7hrZlCa2hSi8sETskoLDchgOrSOVppHWCOUoYleJrOOHP3WBIK8O/1fXEaJPGh0AUIhsm1RDrjptysW476kRslDpBjaJqcktMwW7JzfrzV5A=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:11 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-c7293696-1f00-4ccc-9b53-65c095ad2231 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:33:11 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-c7293696-1f00-4ccc-9b53-65c095ad2231 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for user 7ac79717e12544d39215874f9b99ccf2 and project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:33:11 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c7293696-1f00-4ccc-9b53-65c095ad2231 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066172 Nov 28 14:33:11 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 346/1047] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:33:11 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2143021861", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e1730cd2-e937-4650-bb09-73cc1ca30994"}], "security_groups": [{"name": "tempest-securitygroup--1345782382"}], "key_name": "tempest-keypair-1935967308", "user_data": "}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] validate_networks() for [('e1730cd2-e937-4650-bb09-73cc1ca30994', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting quotas for user 7ac79717e12544d39215874f9b99ccf2 and project c90c4a02d30c48c7b6ee993b9b213c2b. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:33:13 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:33:13 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.603933 Nov 28 14:33:13 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 351/1048] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:33:13 2023] POST /compute/v2.1/servers => generated 407 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:33:13 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-db8b1988-75a2-4cfd-b692-4c6eaad3ca5d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:33:13 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-db8b1988-75a2-4cfd-b692-4c6eaad3ca5d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:33:13 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 14:33:13 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:13 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:13 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-db8b1988-75a2-4cfd-b692-4c6eaad3ca5d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:33:13 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-db8b1988-75a2-4cfd-b692-4c6eaad3ca5d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1238 microversion: 2.1 time: 0.121861 Nov 28 14:33:13 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 352/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:33:13 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:33:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:16 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57094. Nov 28 14:33:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Creating event network-changed:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:33:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Nov 28 14:33:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 347/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:33:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:33:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:33:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102518 Nov 28 14:33:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 352/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:33:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:33:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:20 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59870. Nov 28 14:33:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:33:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035580 Nov 28 14:33:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 353/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:33:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:38 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:33:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-6441844d-e339-4613-8d15-d88e23e34386 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd" status: 200 len: 1535 microversion: 2.1 time: 0.281498 Nov 28 14:33:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 348/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:33:38 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd => generated 1535 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Creating event network-changed:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:33:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042715 Nov 28 14:33:39 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 353/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:33:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4318c6ce-732f-4f02-893f-ce91107dfe30"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299722 Nov 28 14:33:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 354/1055] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:33:40 2023] POST /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:51 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'services' on Instance uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:33:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments/4318c6ce-732f-4f02-893f-ce91107dfe30" status: 202 len: 0 microversion: 2.1 time: 0.161538 Nov 28 14:33:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 349/1056] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:33:51 2023] DELETE /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments/4318c6ce-732f-4f02-893f-ce91107dfe30 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:33:51 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:33:51 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-8c823841-0ee8-45ad-83f6-c8c2a6183135 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051327 Nov 28 14:33:51 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 354/1057] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:33:51 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:04 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:34:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a5824a37-6e52-4fe4-af7c-ae05d96db784 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1553 microversion: 2.1 time: 0.472556 Nov 28 14:34:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 355/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:34:03 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1553 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-66766f99-78fd-4e93-85ad-edd4d2d738b2 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054861 Nov 28 14:34:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 350/1059] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:34:42 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1437353739"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:45 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/action" status: 202 len: 0 microversion: 2.1 time: 0.830989 Nov 28 14:34:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 355/1060] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:34:45 2023] POST /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-228928258", "imageRef": "4d7091b3-9c75-4056-a5d0-87da2e82623a", "flavorRef": "1", "key_name": "tempest-TestStampPattern-840267874", "security_groups": [{"name": "tempest-secgroup-smoke-2003695621"}], "networks": [{"uuid": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] validate_networks() for [('21c4f328-f0be-4825-8ebf-c2ba4b011ed0', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting quotas for project a7a532227da343209095aca11e672e87. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting quotas for user 2b16a7dabefd4644b463e1a45a0b40dd and project a7a532227da343209095aca11e672e87. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:34:53 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d7091b3-9c75-4056-a5d0-87da2e82623a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:34:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.748578 Nov 28 14:34:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 356/1061] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:34:53 2023] POST /compute/v2.1/servers => generated 404 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:34:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c5bad1e1-79a1-4789-a284-a68d54951e6f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:34:54 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c5bad1e1-79a1-4789-a284-a68d54951e6f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:34:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:54 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-c5bad1e1-79a1-4789-a284-a68d54951e6f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:34:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c5bad1e1-79a1-4789-a284-a68d54951e6f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054" status: 200 len: 1233 microversion: 2.1 time: 0.074552 Nov 28 14:34:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 351/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:34:54 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054 => generated 1233 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:34:57 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:57 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:34:57 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:34:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:57 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Creating event network-changed:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:34:57 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055058 Nov 28 14:34:57 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 356/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:34:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "name": "network-vif-plugged", "status": "completed", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:34:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:34:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:34:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:34:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Creating event network-vif-plugged:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:34:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090510 Nov 28 14:34:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 357/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "name": "network-vif-plugged", "status": "completed", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Creating event network-vif-plugged:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:35:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029631 Nov 28 14:35:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 352/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:35:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:04 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:04 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b2c1d89f-ac1e-474f-ac6d-366db406af3d tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.171080 Nov 28 14:35:04 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 357/1066] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:35:04 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-interface => generated 283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:05 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:05 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:05 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:05 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Creating event network-changed:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:35:05 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033828 Nov 28 14:35:05 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 358/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:35:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8d9ba63-449a-49d5-96b4-5b2d5e30e12a"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297360 Nov 28 14:35:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 353/1068] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:35:05 2023] POST /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:15 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:35:15 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/action" status: 200 len: 32 microversion: 2.1 time: 0.168322 Nov 28 14:35:15 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 358/1069] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:35:15 2023] POST /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:15 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:16 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:35:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b766e9b5-c981-40e6-8b50-756ee13195cd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1724 microversion: 2.1 time: 0.216635 Nov 28 14:35:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 359/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:35:15 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:35:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-unplugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Creating event network-vif-unplugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:35:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034772 Nov 28 14:35:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 354/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:35:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:35:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031403 Nov 28 14:35:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 359/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:35:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}, {"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:35:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:35:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:35:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035796 Nov 28 14:35:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 360/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:35:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:35:44 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:35:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c8832dfd-8c60-46e7-9a44-790b19c2df2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054" status: 200 len: 1535 microversion: 2.1 time: 0.219728 Nov 28 14:35:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 355/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:35:44 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054 => generated 1535 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:06 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:36:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9d0e6796-c684-47c8-ba9e-609e352ee8b9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1704 microversion: 2.1 time: 0.297360 Nov 28 14:36:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 360/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:36:06 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1704 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:44 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:36:44 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-de024cdc-a2b8-4a20-aa62-3aea37745639 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054" status: 200 len: 1535 microversion: 2.1 time: 0.303732 Nov 28 14:36:44 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 361/1076] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:36:44 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054 => generated 1535 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:36:45 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:45 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:45 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:36:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:45 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Creating event network-changed:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:36:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040557 Nov 28 14:36:46 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 356/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:36:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297923 Nov 28 14:36:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 361/1078] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:36:46 2023] POST /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:57 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'services' on Instance uuid 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:36:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments/0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857" status: 202 len: 0 microversion: 2.1 time: 0.169131 Nov 28 14:36:57 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 362/1079] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:36:57 2023] DELETE /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments/0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:36:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:36:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-2641a968-22fa-4033-8e54-1a555e8fd617 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048751 Nov 28 14:36:57 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 357/1080] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:36:57 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] HTTP exception thrown: Cannot 'detach_volume' instance e1c46e9d-f04c-4e5f-975e-cf191849d243 while it is in vm_state rescued Nov 28 14:37:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Returning 409 to user: Cannot 'detach_volume' instance e1c46e9d-f04c-4e5f-975e-cf191849d243 while it is in vm_state rescued {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:37:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-de4845b7-075e-4fbd-8dd7-1f817092ac9f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments/c8d9ba63-449a-49d5-96b4-5b2d5e30e12a" status: 409 len: 152 microversion: 2.1 time: 0.102454 Nov 28 14:37:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 362/1081] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:37:06 2023] DELETE /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments/c8d9ba63-449a-49d5-96b4-5b2d5e30e12a => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:06 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:06 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/action" status: 202 len: 0 microversion: 2.1 time: 0.092293 Nov 28 14:37:06 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 363/1082] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:37:06 2023] POST /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:06 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:07 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:37:07 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0f9a365e-c5d5-4afd-9084-0f99bde6e83a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1712 microversion: 2.1 time: 0.326615 Nov 28 14:37:07 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 358/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:37:06 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1712 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:37:07 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-unplugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:07 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Creating event network-vif-unplugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:37:07 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035188 Nov 28 14:37:07 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 363/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:09 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}, {"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}, {"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:37:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:37:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:37:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040837 Nov 28 14:37:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 364/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:37:09 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=12 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7716f199-6415-459e-b565-0f61f3c2d291 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056654 Nov 28 14:37:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 359/1086] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:37:47 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Creating event network-changed:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:37:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037718 Nov 28 14:37:48 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 365/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:48 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:37:48 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054" status: 204 len: 0 microversion: 2.1 time: 0.142106 Nov 28 14:37:48 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 364/1088] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:37:48 2023] DELETE /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "name": "network-vif-unplugged", "status": "completed", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:48 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Creating event network-vif-unplugged:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:37:48 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038984 Nov 28 14:37:48 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 366/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:48 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:37:48 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e7a43745-f4d9-4416-9994-5a1058fc1c23 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054" status: 200 len: 1659 microversion: 2.1 time: 0.523435 Nov 28 14:37:48 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 360/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:37:48 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054 => generated 1659 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:37:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "name": "network-vif-deleted", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] Creating event network-vif-deleted:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:37:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126139 Nov 28 14:37:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 365/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:50 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba93f3-9a83-4618-b572-4cb6d1a36054", "name": "network-vif-plugged", "status": "completed", "tag": "0bb234d0-7036-4182-af11-1368ec192e51"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:37:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:50 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Creating event network-vif-plugged:0bb234d0-7036-4182-af11-1368ec192e51 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 on user Nov 28 14:37:50 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034351 Nov 28 14:37:50 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 367/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:37:57 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:37:57 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f2c13ce1-6023-41e9-8c21-f503bf907b76 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1718 microversion: 2.1 time: 0.204814 Nov 28 14:37:57 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 361/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:37:57 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1718 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] HTTP exception thrown: Instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 could not be found. Nov 28 14:38:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Returning 404 to user: Instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:38:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-58d69642-2f9e-456e-96d4-af7064b9c185 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054" status: 404 len: 111 microversion: 2.1 time: 0.037083 Nov 28 14:38:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 366/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:38:38 2023] GET /compute/v2.1/servers/63ba93f3-9a83-4618-b572-4cb6d1a36054 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] HTTP exception thrown: Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd is not attached to volume 4318c6ce-732f-4f02-893f-ce91107dfe30 Nov 28 14:38:45 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Returning 404 to user: Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd is not attached to volume 4318c6ce-732f-4f02-893f-ce91107dfe30 {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:38:45 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0903102e-ca7f-4e69-99b3-10208702f39a tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments/4318c6ce-732f-4f02-893f-ce91107dfe30" status: 404 len: 154 microversion: 2.1 time: 0.213865 Nov 28 14:38:45 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 368/1095] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:38:45 2023] DELETE /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd/os-volume_attachments/4318c6ce-732f-4f02-893f-ce91107dfe30 => generated 154 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=18 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Creating event network-changed:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030195 Nov 28 14:38:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 367/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:38:46 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:38:46 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd" status: 204 len: 0 microversion: 2.1 time: 0.129385 Nov 28 14:38:46 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 362/1097] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:38:46 2023] DELETE /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:46 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:38:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-10e44a2b-05f9-473c-ae1b-c19201298c2f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd" status: 200 len: 1659 microversion: 2.1 time: 0.256260 Nov 28 14:38:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 369/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:38:46 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd => generated 1659 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-unplugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Creating event network-vif-unplugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:46 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028224 Nov 28 14:38:46 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 368/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:38:48 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-plugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}, {"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-plugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}, {"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-plugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}, {"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-unplugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}, {"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-plugged", "status": "completed", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}, {"server_uuid": "7c3306d3-7632-4369-bdf9-8ace904a05fd", "name": "network-vif-deleted", "tag": "03247349-1758-4904-ae30-79ca21ccdd7c"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:38:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Creating event network-vif-plugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Creating event network-vif-plugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Creating event network-vif-plugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Creating event network-vif-unplugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Creating event network-vif-plugged:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Creating event network-vif-deleted:03247349-1758-4904-ae30-79ca21ccdd7c for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd on user Nov 28 14:38:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.033790 Nov 28 14:38:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 363/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:38:48 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:57 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:57 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f7d80a47-a643-4e0e-9619-42ce4d2a19d2 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.176370 Nov 28 14:38:57 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 370/1101] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:38:57 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-interface => generated 283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:38:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:38:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:38:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Creating event network-changed:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:38:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036801 Nov 28 14:38:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 369/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:38:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:58 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'services' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:38:58 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments/c8d9ba63-449a-49d5-96b4-5b2d5e30e12a" status: 202 len: 0 microversion: 2.1 time: 0.293713 Nov 28 14:38:58 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 364/1103] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:38:58 2023] DELETE /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments/c8d9ba63-449a-49d5-96b4-5b2d5e30e12a => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:38:58 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:38:58 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f8fecc72-b956-41e2-a98a-58067f3fc105 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063890 Nov 28 14:38:58 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 371/1104] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:38:58 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:39:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:39:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Creating event network-changed:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:39:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029376 Nov 28 14:39:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 370/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:39:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] HTTP exception thrown: Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd could not be found. Nov 28 14:39:36 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Returning 404 to user: Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:39:36 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-d24bfdc4-0d20-4ae6-a77b-944930ad141c tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd" status: 404 len: 111 microversion: 2.1 time: 0.037975 Nov 28 14:39:36 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 365/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:39:36 2023] GET /compute/v2.1/servers/7c3306d3-7632-4369-bdf9-8ace904a05fd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:39:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-fd72145e-98de-4a43-b499-d2459abe2662 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Calling method '.version_select at 0x7fedf0189f30>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:39:40 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:40 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-fd72145e-98de-4a43-b499-d2459abe2662 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-840267874" status: 202 len: 0 microversion: 2.1 time: 0.039078 Nov 28 14:39:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 372/1107] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 14:39:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-840267874 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:48 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-7fd5421c-3e3f-431e-8a5b-0be50a1b4d2f tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060803 Nov 28 14:39:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 371/1108] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:39:48 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:49 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:39:49 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 204 len: 0 microversion: 2.1 time: 0.116768 Nov 28 14:39:49 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 366/1109] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:39:49 2023] DELETE /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:49 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:39:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-886f632d-f3d7-4bf8-9b6c-c8a8ab27b717 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 200 len: 1678 microversion: 2.1 time: 0.245043 Nov 28 14:39:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 373/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:39:49 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:39:49 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-unplugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:39:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:49 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Creating event network-vif-unplugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:39:49 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.225464 Nov 28 14:39:49 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 372/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:39:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-deleted", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:39:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] Creating event network-vif-deleted:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:39:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Nov 28 14:39:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 367/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:39:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:39:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c46e9d-f04c-4e5f-975e-cf191849d243", "name": "network-vif-plugged", "status": "completed", "tag": "9b815f80-08ff-4406-840c-b2152652eea6"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:39:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:39:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:39:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:39:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Creating event network-vif-plugged:9b815f80-08ff-4406-840c-b2152652eea6 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 on user Nov 28 14:39:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042187 Nov 28 14:39:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 374/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:39:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:00 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:00 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-46739f06-8e0c-4855-afad-9ecc17274140 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Action: 'create', calling method: .version_select at 0x7fedf0185ab0>, body: {"keypair": {"name": "tempest-keypair-1040277365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBaKb7rg6g18x4j0eX1QsE3yUrnfWe74mIrqrgLURwj6/hcCtSxFbZTDVQGURU3/kHArSgm8BsUBT8Ti0m+d6rAKAIHzukl416ZdeeOkKnesdNlp7zR6Oa/aR2XNNr1/w=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:00 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-46739f06-8e0c-4855-afad-9ecc17274140 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting quotas for project b1e256bfa6e74f7bbd126a9fd943644d. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:40:00 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-46739f06-8e0c-4855-afad-9ecc17274140 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting quotas for user a4c1c7c913b841ab85f8615bc9f8fc04 and project b1e256bfa6e74f7bbd126a9fd943644d. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:40:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-46739f06-8e0c-4855-afad-9ecc17274140 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.272791 Nov 28 14:40:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 373/1114] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:40:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:02 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:02 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-970246909", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "key_name": "tempest-keypair-1040277365", "security_groups": [{"name": "tempest-secgroup-smoke-1159503144"}, {"name": "tempest-securitygroup--842218622"}], "networks": [{"uuid": "c4f5d8c6-5294-4666-a5ad-5359bd17d219"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] validate_networks() for [('c4f5d8c6-5294-4666-a5ad-5359bd17d219', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting quotas for project b1e256bfa6e74f7bbd126a9fd943644d. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting quotas for user a4c1c7c913b841ab85f8615bc9f8fc04 and project b1e256bfa6e74f7bbd126a9fd943644d. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:40:03 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:40:03 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 0.704882 Nov 28 14:40:03 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 368/1115] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:40:02 2023] POST /compute/v2.1/servers => generated 450 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:40:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ca12fbbb-ccbf-40ab-9846-0f389213c183 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:40:03 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ca12fbbb-ccbf-40ab-9846-0f389213c183 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:40:03 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-ca12fbbb-ccbf-40ab-9846-0f389213c183 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1c7c913b841ab85f8615bc9f8fc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e256bfa6e74f7bbd126a9fd943644d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:40:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ca12fbbb-ccbf-40ab-9846-0f389213c183 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c" status: 200 len: 1235 microversion: 2.1 time: 0.067091 Nov 28 14:40:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 375/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:40:03 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c => generated 1235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:40:06 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:06 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Creating event network-changed:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:40:06 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Nov 28 14:40:06 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 374/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:08 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "name": "network-vif-plugged", "status": "completed", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:08 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Creating event network-vif-plugged:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:40:08 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Nov 28 14:40:08 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 369/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:40:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:10 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "name": "network-vif-plugged", "status": "completed", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:10 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Creating event network-vif-plugged:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:40:10 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029130 Nov 28 14:40:10 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 376/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:40:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] HTTP exception thrown: Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 could not be found. Nov 28 14:40:39 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Returning 404 to user: Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:40:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-9a20e8be-0a3d-4aa9-b3bb-2bcb614e0526 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243" status: 404 len: 111 microversion: 2.1 time: 0.070419 Nov 28 14:40:39 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 375/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:40:39 2023] GET /compute/v2.1/servers/e1c46e9d-f04c-4e5f-975e-cf191849d243 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:40:39 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:39 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f74808f9-4aec-413b-8d1a-661d80adf7f4 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '.version_select at 0x7fedebe1a440>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:40:39 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f74808f9-4aec-413b-8d1a-661d80adf7f4 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935967308" status: 202 len: 0 microversion: 2.1 time: 0.032694 Nov 28 14:40:39 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 370/1121] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:40:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935967308 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:40:46 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 204 len: 0 microversion: 2.1 time: 0.128927 Nov 28 14:40:46 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 377/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:40:46 2023] DELETE /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:46 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-unplugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:47 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Creating event network-vif-unplugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:40:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034775 Nov 28 14:40:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 371/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:40:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:47 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:40:47 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-86d9f1ae-30d0-4e80-95d4-132cfa4760b7 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 200 len: 1494 microversion: 2.1 time: 0.444231 Nov 28 14:40:47 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 376/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:40:46 2023] GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 1494 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:40:49 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-plugged", "status": "completed", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}, {"server_uuid": "b1db2136-7fba-4701-bbc0-afee6b009a3c", "name": "network-vif-deleted", "tag": "13b2b5c8-da0f-4c65-a267-199ae324844d"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:40:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:49 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Creating event network-vif-plugged:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:40:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Creating event network-vif-deleted:13b2b5c8-da0f-4c65-a267-199ae324844d for instance b1db2136-7fba-4701-bbc0-afee6b009a3c on user Nov 28 14:40:49 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029366 Nov 28 14:40:49 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 378/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:40:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:40:53 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:40:54 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1c7c913b841ab85f8615bc9f8fc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e256bfa6e74f7bbd126a9fd943644d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:40:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8f9aac22-69bb-420a-bcba-023db23adb55 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c" status: 200 len: 1592 microversion: 2.1 time: 0.253756 Nov 28 14:40:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 372/1126] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:40:53 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c => generated 1592 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] HTTP exception thrown: Instance b1db2136-7fba-4701-bbc0-afee6b009a3c could not be found. Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Returning 404 to user: Instance b1db2136-7fba-4701-bbc0-afee6b009a3c could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:41:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ee2b9b88-283a-41b5-aad8-4dce827cebfb tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c" status: 404 len: 111 microversion: 2.1 time: 0.138760 Nov 28 14:41:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 377/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:41:37 2023] GET /compute/v2.1/servers/b1db2136-7fba-4701-bbc0-afee6b009a3c => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:41:37 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:41:37 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 204 len: 0 microversion: 2.1 time: 0.115215 Nov 28 14:41:37 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 379/1128] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:41:37 2023] DELETE /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-unplugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Creating event network-vif-unplugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043977 Nov 28 14:41:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 378/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:41:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:41:37 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:41:37 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0877754d-57a8-481c-9416-be44ae2ea2fe tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 200 len: 1508 microversion: 2.1 time: 0.346416 Nov 28 14:41:37 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 373/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:41:37 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:41:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-deleted", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:41:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] Creating event network-vif-deleted:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035475 Nov 28 14:41:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 380/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:41:39 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}, {"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}, {"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}, {"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-unplugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}, {"server_uuid": "23f4cfb9-18d6-419b-9fb0-23a0da9da00f", "name": "network-vif-plugged", "status": "completed", "tag": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:41:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:39 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Creating event network-vif-unplugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Creating event network-vif-plugged:3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f on user Nov 28 14:41:39 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031198 Nov 28 14:41:39 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 379/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-8efb78a3-069d-42b7-8c1d-27b9805b2fff tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.170340 Nov 28 14:41:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 374/1133] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:41:54 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:41:54 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:54 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:41:54 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33674. Nov 28 14:41:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Creating event network-changed:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:41:54 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Nov 28 14:41:54 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 381/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:41:56 user devstack@n-api.service[65025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:56 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1c7c913b841ab85f8615bc9f8fc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e256bfa6e74f7bbd126a9fd943644d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:41:56 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-34677037-8138-4714-a9e3-a9499d2840bf tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c" status: 200 len: 1710 microversion: 2.1 time: 0.184148 Nov 28 14:41:56 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 380/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:41:56 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de2c059a-e1f7-43bd-b107-0c0314f358d2"}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:41:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:41:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295672 Nov 28 14:41:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 375/1136] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:41:59 2023] POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:42:24 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'services' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:42:24 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/de2c059a-e1f7-43bd-b107-0c0314f358d2" status: 202 len: 0 microversion: 2.1 time: 0.156838 Nov 28 14:42:24 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 382/1137] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:42:24 2023] DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/de2c059a-e1f7-43bd-b107-0c0314f358d2 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:42:24 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:42:24 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41886. Nov 28 14:42:24 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-bbf37221-d028-4f30-a0a0-508fb8ff00a7 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057855 Nov 28 14:42:24 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 381/1138] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:42:24 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:42:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] HTTP exception thrown: Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f could not be found. Nov 28 14:42:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Returning 404 to user: Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:42:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-797c6dde-8da8-49d1-9996-3d1e9fa29dd6 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f" status: 404 len: 111 microversion: 2.1 time: 0.038397 Nov 28 14:42:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 376/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:42:27 2023] GET /compute/v2.1/servers/23f4cfb9-18d6-419b-9fb0-23a0da9da00f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:14 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:14 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-890189f8-d8aa-4312-82cf-48e58dd72e4b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056522 Nov 28 14:43:14 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 383/1140] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:43:14 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af91e531-32c4-42e0-8e83-3f008081bda4"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289208 Nov 28 14:43:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 382/1141] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:43:17 2023] POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:43:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:25 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f2760752-0c79-47d7-8d41-3cbb6d5d1c5f tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Action: 'create', calling method: .version_select at 0x7fedebe191b0>, body: {"keypair": {"name": "tempest-keypair-1925480414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHHW6xOOkXA6HO6AyAtKqVaWqyVEs+REq4AOqAeGr8O/kcUci05pEH4UptKQ7ADA4MvvQJQ9S1flPRz4ednzYhnCvycjaMwmgIoVO324NA/FvuJTcVVlJCZ83QkrfxBTA=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:43:25 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-f2760752-0c79-47d7-8d41-3cbb6d5d1c5f tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Getting quotas for project 5869d755289842bf9d1e4006eed3ad7e. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:43:25 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-f2760752-0c79-47d7-8d41-3cbb6d5d1c5f tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Getting quotas for user 61811e8f2c74409c86b108ac9c7647e2 and project 5869d755289842bf9d1e4006eed3ad7e. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:43:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f2760752-0c79-47d7-8d41-3cbb6d5d1c5f tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188422 Nov 28 14:43:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 377/1142] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:43:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881", "imageRef": "0d03e2fc-4d16-4fd7-9616-933da07dcf7b", "flavorRef": "1", "networks": [{"uuid": "f13184a0-39de-4810-a596-b27f7cd0bebd"}], "security_groups": [{"name": "tempest-securitygroup--1805141787"}], "key_name": "tempest-keypair-1925480414", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] validate_networks() for [('f13184a0-39de-4810-a596-b27f7cd0bebd', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Getting quotas for project 5869d755289842bf9d1e4006eed3ad7e. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Getting quotas for user 61811e8f2c74409c86b108ac9c7647e2 and project 5869d755289842bf9d1e4006eed3ad7e. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:43:27 user devstack@n-api.service[65027]: WARNING nova.utils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826 Nov 28 14:43:27 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:43:27 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.664392 Nov 28 14:43:27 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 384/1143] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:43:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:43:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:27 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:43:27 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-48fa83a6-63c4-4415-aec1-e2530a1dc344 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:43:27 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-48fa83a6-63c4-4415-aec1-e2530a1dc344 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:43:28 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-48fa83a6-63c4-4415-aec1-e2530a1dc344 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61811e8f2c74409c86b108ac9c7647e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5869d755289842bf9d1e4006eed3ad7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:43:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-48fa83a6-63c4-4415-aec1-e2530a1dc344 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" status: 200 len: 1250 microversion: 2.1 time: 0.077727 Nov 28 14:43:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 383/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:43:27 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb => generated 1250 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:29 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'services' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:43:29 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/af91e531-32c4-42e0-8e83-3f008081bda4" status: 202 len: 0 microversion: 2.1 time: 0.172222 Nov 28 14:43:29 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 378/1145] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:43:29 2023] DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/af91e531-32c4-42e0-8e83-3f008081bda4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:29 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:29 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a7bf38a2-8efe-40b6-95fe-49369a36f84e tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048736 Nov 28 14:43:29 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 385/1146] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:43:29 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:43:30 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:43:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:30 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Creating event network-changed:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:43:30 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127875 Nov 28 14:43:30 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 384/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:43:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 14:43:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "name": "network-vif-plugged", "status": "completed", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:43:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Creating event network-vif-plugged:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:43:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126696 Nov 28 14:43:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 379/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:43:34 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "name": "network-vif-plugged", "status": "completed", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:43:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:43:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:43:34 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:43:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Creating event network-vif-plugged:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:43:34 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029299 Nov 28 14:43:34 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 386/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:18 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61811e8f2c74409c86b108ac9c7647e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5869d755289842bf9d1e4006eed3ad7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:44:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c9d8cf8e-924e-4eb7-87f8-9b60e1989015 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" status: 200 len: 1577 microversion: 2.1 time: 0.218978 Nov 28 14:44:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 385/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:44:18 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:44:19 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:44:19 user devstack@n-api.service[65026]: Tue Nov 28 14:44:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a2912d27-783e-4067-8981-c4ecc2f35dbc tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053408 Nov 28 14:44:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 380/1151] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:44:19 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02d43b32-f7b2-43a1-8c4b-c9800b8f0b08"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:22 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:22 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444678 Nov 28 14:44:22 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 387/1152] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:44:22 2023] POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:34 user devstack@n-api.service[65025]: DEBUG nova.objects.instance [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'services' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=65025) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:44:34 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/02d43b32-f7b2-43a1-8c4b-c9800b8f0b08" status: 202 len: 0 microversion: 2.1 time: 0.167776 Nov 28 14:44:34 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 386/1153] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:44:33 2023] DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:44:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:44:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-06133e67-843b-416a-ae79-646359d91996 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051701 Nov 28 14:44:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 381/1154] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:44:34 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-c3df2949-946b-46b6-9092-d9a81beeb8a9 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.162971 Nov 28 14:45:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 388/1155] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:45:18 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-interface => generated 283 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:19 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:19 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:19 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:45:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:19 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Creating event network-changed:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:45:19 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039251 Nov 28 14:45:19 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 387/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:45:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:19 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61811e8f2c74409c86b108ac9c7647e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5869d755289842bf9d1e4006eed3ad7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:45:19 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-29fb8b4e-a6bb-48ce-b4cf-fed28c53ecd1 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" status: 200 len: 1577 microversion: 2.1 time: 0.400891 Nov 28 14:45:19 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 382/1157] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:45:19 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb => generated 1577 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61811e8f2c74409c86b108ac9c7647e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5869d755289842bf9d1e4006eed3ad7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Searching by: {'deleted': False, 'project_id': '5869d755289842bf9d1e4006eed3ad7e'} {{(pid=65027) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:19 user devstack@n-api.service[65027]: DEBUG nova.compute.multi_cell_list [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65027) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 14:45:19 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-dfd52286-aa4e-4fdf-95e9-81c0118b58cf tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 357 microversion: 2.1 time: 0.070091 Nov 28 14:45:19 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 389/1158] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 14:45:19 2023] GET /compute/v2.1/servers => generated 357 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "195e340a-bb12-4ce5-8447-c0c620362f71"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273577 Nov 28 14:45:22 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 388/1159] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:45:22 2023] POST /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:24 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:24 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f41a756d-dcfe-4c37-ba8a-e88feab6e22b tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154293 Nov 28 14:45:24 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 383/1160] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:45:24 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d6bee7a-e542-4719-b521-3fb34fa7179b"}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:27 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:27 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289403 Nov 28 14:45:27 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 390/1161] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 14:45:27 2023] POST /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG nova.compute.api [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-1f75a249-c117-4254-8d59-16c6db8e59e1 req-d56f4f2d-124c-4061-b7f4-6b2062ffe0fd tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71" status: 200 len: 302 microversion: 2.89 time: 0.092599 Nov 28 14:45:32 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 389/1162] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:45:32 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71 => generated 302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-7ae689e1-33d5-4c16-8bbe-19bbecb19553 req-888e0372-d681-4b20-9482-9d440bf52834 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71" status: 200 len: 302 microversion: 2.89 time: 0.110242 Nov 28 14:45:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 384/1163] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 14:45:32 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71 => generated 302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:32 user devstack@n-api.service[65027]: DEBUG nova.objects.instance [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lazy-loading 'services' on Instance uuid a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=65027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:45:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71" status: 202 len: 0 microversion: 2.1 time: 0.194990 Nov 28 14:45:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 391/1164] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:45:32 2023] DELETE /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:33 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e998b14b-a3ac-4967-8ee6-a548a62c3ca8 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047684 Nov 28 14:45:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 390/1165] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:45:33 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:38 user devstack@n-api.service[65026]: DEBUG nova.objects.instance [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'services' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=65026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 14:45:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/7d6bee7a-e542-4719-b521-3fb34fa7179b" status: 202 len: 0 microversion: 2.1 time: 0.166334 Nov 28 14:45:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 385/1166] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:45:38 2023] DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments/7d6bee7a-e542-4719-b521-3fb34fa7179b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:45:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:45:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-3f1db694-a2c1-4ca7-ba63-8d4f38ae23ba tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 Nov 28 14:45:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 392/1167] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:45:38 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:23 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:23 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d7d10beb-9f18-4ce7-b94c-d43f48dcd3e6 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055014 Nov 28 14:46:23 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 391/1168] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:46:23 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] HTTP exception thrown: Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb is not attached to volume 195e340a-bb12-4ce5-8447-c0c620362f71 Nov 28 14:46:23 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Returning 404 to user: Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb is not attached to volume 195e340a-bb12-4ce5-8447-c0c620362f71 {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:46:23 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-55bff509-5590-4750-97dd-dee989852997 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71" status: 404 len: 154 microversion: 2.1 time: 0.106560 Nov 28 14:46:23 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 386/1169] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 14:46:23 2023] DELETE /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/os-volume_attachments/195e340a-bb12-4ce5-8447-c0c620362f71 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=10 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:46:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" status: 204 len: 0 microversion: 2.1 time: 0.144428 Nov 28 14:46:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 393/1170] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:46:26 2023] DELETE /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:27 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "name": "network-vif-unplugged", "status": "completed", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:46:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:27 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Creating event network-vif-unplugged:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:46:27 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037094 Nov 28 14:46:27 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 387/1171] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:46:27 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61811e8f2c74409c86b108ac9c7647e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5869d755289842bf9d1e4006eed3ad7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:46:27 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-39321c02-ffb5-49b6-8810-2ea4cdf7db92 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" status: 200 len: 1701 microversion: 2.1 time: 0.299719 Nov 28 14:46:27 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 392/1172] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:46:26 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb => generated 1701 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:46:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "name": "network-vif-deleted", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:46:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] Creating event network-vif-deleted:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:46:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032455 Nov 28 14:46:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 394/1173] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4dc02e32-61d3-47f8-9836-79bc558c6c01 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049235 Nov 28 14:46:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 388/1174] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 14:46:28 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 14:46:29 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb", "name": "network-vif-plugged", "status": "completed", "tag": "4b6f3d19-5c51-46b3-9f2c-5171434afd99"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:46:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:29 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:29 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Creating event network-vif-plugged:4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb on user Nov 28 14:46:29 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033117 Nov 28 14:46:29 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 393/1175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:52 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:46:52 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c" status: 204 len: 0 microversion: 2.1 time: 0.149136 Nov 28 14:46:52 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 395/1176] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:46:52 2023] DELETE /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=14 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=14 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:46:52 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1c7c913b841ab85f8615bc9f8fc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e256bfa6e74f7bbd126a9fd943644d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:46:52 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-459ee937-d83f-4942-a2f6-ee243e88fa08 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c" status: 200 len: 1716 microversion: 2.1 time: 0.297210 Nov 28 14:46:52 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 389/1177] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:46:52 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c => generated 1716 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:46:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "name": "network-vif-unplugged", "status": "completed", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:46:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Creating event network-vif-unplugged:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:46:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112874 Nov 28 14:46:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 394/1178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:46:53 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "name": "network-vif-deleted", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:46:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:53 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:53 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] Creating event network-vif-deleted:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:46:53 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Nov 28 14:46:53 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 396/1179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:46:54 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e174b-68e8-413f-adc7-27c899ad004c", "name": "network-vif-plugged", "status": "completed", "tag": "9659cf88-5aba-4655-ab65-0dbc2163dc2a"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:46:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:46:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:46:54 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:46:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Creating event network-vif-plugged:9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance da6e174b-68e8-413f-adc7-27c899ad004c on user Nov 28 14:46:54 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031787 Nov 28 14:46:54 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 390/1180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] HTTP exception thrown: Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb could not be found. Nov 28 14:47:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Returning 404 to user: Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:47:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1893757c-3996-455e-8ffa-03670885cb2b tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" status: 404 len: 111 microversion: 2.1 time: 0.038463 Nov 28 14:47:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 395/1181] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:47:17 2023] GET /compute/v2.1/servers/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:47:17 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:17 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a9d288f7-39cf-43e9-bb43-4dd03c55308f tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Calling method '.version_select at 0x7fedebf65750>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:47:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a9d288f7-39cf-43e9-bb43-4dd03c55308f tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925480414" status: 202 len: 0 microversion: 2.1 time: 0.030775 Nov 28 14:47:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 397/1182] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:47:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925480414 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] HTTP exception thrown: Instance da6e174b-68e8-413f-adc7-27c899ad004c could not be found. Nov 28 14:47:42 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Returning 404 to user: Instance da6e174b-68e8-413f-adc7-27c899ad004c could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:47:42 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-06ebfbc9-d4eb-4841-88a1-9be1aef660d5 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c" status: 404 len: 111 microversion: 2.1 time: 0.043858 Nov 28 14:47:42 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 391/1183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:47:42 2023] GET /compute/v2.1/servers/da6e174b-68e8-413f-adc7-27c899ad004c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:47:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:42 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:42 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-bd8dc0cd-3c89-409c-8029-9a3bcf888103 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Calling method '.version_select at 0x7fedf0187370>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:47:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-bd8dc0cd-3c89-409c-8029-9a3bcf888103 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040277365" status: 202 len: 0 microversion: 2.1 time: 0.032086 Nov 28 14:47:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 396/1184] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:47:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040277365 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1541938524", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "1840543d-d85e-403b-a614-e9974126a065", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e134f287-51ba-4042-9230-b9b6754caa53"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] validate_networks() for [('e134f287-51ba-4042-9230-b9b6754caa53', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:47:46 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1840543d-d85e-403b-a614-e9974126a065',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:47:47 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.909788 Nov 28 14:47:47 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 398/1185] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:47:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:47:47 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-0bf58212-8a9f-433c-80a0-be9522c453ec tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:47:47 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-0bf58212-8a9f-433c-80a0-be9522c453ec tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:47:47 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-0bf58212-8a9f-433c-80a0-be9522c453ec tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:47:47 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-0bf58212-8a9f-433c-80a0-be9522c453ec tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 200 len: 1050 microversion: 2.1 time: 0.068673 Nov 28 14:47:47 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 392/1186] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:47:47 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 1050 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:47:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fccc41-f928-4fea-a8aa-669cc1889847", "tag": "61141649-30cf-459d-9ddc-261b3c0b0280"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:47:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:47:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:47:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:47:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Creating event network-changed:61141649-30cf-459d-9ddc-261b3c0b0280 for instance a9fccc41-f928-4fea-a8aa-669cc1889847 on user Nov 28 14:47:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034708 Nov 28 14:47:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 397/1187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fccc41-f928-4fea-a8aa-669cc1889847", "name": "network-vif-plugged", "status": "completed", "tag": "61141649-30cf-459d-9ddc-261b3c0b0280"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:48:03 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:48:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Creating event network-vif-plugged:61141649-30cf-459d-9ddc-261b3c0b0280 for instance a9fccc41-f928-4fea-a8aa-669cc1889847 on user Nov 28 14:48:03 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047266 Nov 28 14:48:03 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 399/1188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fccc41-f928-4fea-a8aa-669cc1889847", "name": "network-vif-plugged", "status": "completed", "tag": "61141649-30cf-459d-9ddc-261b3c0b0280"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:48:05 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:48:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Creating event network-vif-plugged:61141649-30cf-459d-9ddc-261b3c0b0280 for instance a9fccc41-f928-4fea-a8aa-669cc1889847 on user Nov 28 14:48:05 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042258 Nov 28 14:48:05 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 393/1189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:48:37 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:48:37 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-29ca5eb6-5403-4ff4-a9e6-7b3e10d4f3ee tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 200 len: 1377 microversion: 2.1 time: 0.238754 Nov 28 14:48:37 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 398/1190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:48:37 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 1377 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:37 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:49:37 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-ebb4a6a8-19d2-4cbb-b5c6-0062644e3ce1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 200 len: 1377 microversion: 2.1 time: 0.359754 Nov 28 14:49:37 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 400/1191] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:49:37 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 1377 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:49:37 user devstack@n-api.service[65026]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:37 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:38 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:49:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-2fb6514b-884b-4ebb-bb42-413a0d16ce21 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 200 len: 1377 microversion: 2.1 time: 0.360611 Nov 28 14:49:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 394/1192] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:49:37 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 1377 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:38 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:49:38 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 204 len: 0 microversion: 2.1 time: 0.136347 Nov 28 14:49:38 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 399/1193] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:49:38 2023] DELETE /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:38 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:49:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a2c65357-4ea3-493c-9c3e-827baaf5d352 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 200 len: 1383 microversion: 2.1 time: 0.159301 Nov 28 14:49:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 401/1194] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:49:38 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 1383 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:49:38 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fccc41-f928-4fea-a8aa-669cc1889847", "name": "network-vif-unplugged", "status": "completed", "tag": "61141649-30cf-459d-9ddc-261b3c0b0280"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:49:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Creating event network-vif-unplugged:61141649-30cf-459d-9ddc-261b3c0b0280 for instance a9fccc41-f928-4fea-a8aa-669cc1889847 on user Nov 28 14:49:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048298 Nov 28 14:49:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 395/1195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:49:40 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fccc41-f928-4fea-a8aa-669cc1889847", "name": "network-vif-deleted", "tag": "61141649-30cf-459d-9ddc-261b3c0b0280"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:49:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:40 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] Creating event network-vif-deleted:61141649-30cf-459d-9ddc-261b3c0b0280 for instance a9fccc41-f928-4fea-a8aa-669cc1889847 on user Nov 28 14:49:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128714 Nov 28 14:49:40 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 400/1196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:49:40 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fccc41-f928-4fea-a8aa-669cc1889847", "name": "network-vif-plugged", "status": "completed", "tag": "61141649-30cf-459d-9ddc-261b3c0b0280"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:49:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:49:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:49:40 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:49:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Creating event network-vif-plugged:61141649-30cf-459d-9ddc-261b3c0b0280 for instance a9fccc41-f928-4fea-a8aa-669cc1889847 on user Nov 28 14:49:40 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140166 Nov 28 14:49:40 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 402/1197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:50:28 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 14:50:28 user devstack@n-api.service[65026]: Tue Nov 28 14:50:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 (ip 10.0.0.210) !!! Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:28 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52940. Nov 28 14:50:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance a9fccc41-f928-4fea-a8aa-669cc1889847 could not be found. Nov 28 14:50:28 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance a9fccc41-f928-4fea-a8aa-669cc1889847 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:50:28 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-3e4717e2-0a53-4092-ad08-75069879649e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 404 len: 111 microversion: 2.1 time: 0.046607 Nov 28 14:50:28 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 396/1198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:50:28 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:50:28 user devstack@n-api.service[65025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance a9fccc41-f928-4fea-a8aa-669cc1889847 could not be found. Nov 28 14:50:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance a9fccc41-f928-4fea-a8aa-669cc1889847 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:50:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-475f22ef-ef1d-4a96-87a2-b5120af05112 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 404 len: 111 microversion: 2.1 time: 0.035447 Nov 28 14:50:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 401/1199] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:50:28 2023] DELETE /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=14 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance a9fccc41-f928-4fea-a8aa-669cc1889847 could not be found. Nov 28 14:50:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance a9fccc41-f928-4fea-a8aa-669cc1889847 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:50:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-f9d5aa02-a26c-429a-a9a1-15285d2565cc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847" status: 404 len: 111 microversion: 2.1 time: 0.039790 Nov 28 14:50:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 403/1200] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:50:28 2023] GET /compute/v2.1/servers/a9fccc41-f928-4fea-a8aa-669cc1889847 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:50:40 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-7bf55c06-d3d2-4c33-963b-801c6ee4ee4d tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: .version_select at 0x7fedebf96440>, body: {"keypair": {"name": "tempest-keypair-859234956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhB2kJ20aciKhL9XO+yEcWexH9qTAOKavq0XBDXr6Xy+MdWT0FlTwKQDfAIRX1gg9yUaIqUoa/biZ3jVEhPDOL+0zGdQle1eLvjoUiGakKYViDdIuRtzlPgHCGb5H2PGA=="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:50:40 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:40 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:40 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-7bf55c06-d3d2-4c33-963b-801c6ee4ee4d tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:50:40 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-7bf55c06-d3d2-4c33-963b-801c6ee4ee4d tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'key_pairs'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:50:40 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-7bf55c06-d3d2-4c33-963b-801c6ee4ee4d tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060878 Nov 28 14:50:40 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 397/1201] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:50:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:50:41 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-358520062", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "fa43a66e-7d14-41b9-8486-7a6102750171", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e134f287-51ba-4042-9230-b9b6754caa53"}], "security_groups": [{"name": "tempest-securitygroup--1793452390"}], "key_name": "tempest-keypair-859234956", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:50:41 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:41 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:41 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45278. Nov 28 14:50:41 user devstack@n-api.service[65025]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] validate_networks() for [('e134f287-51ba-4042-9230-b9b6754caa53', None, None, None, None, None)] {{(pid=65025) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65025) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Going to run 1 instances... {{(pid=65025) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:50:42 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa43a66e-7d14-41b9-8486-7a6102750171',volume_size=None,volume_type=None)] {{(pid=65025) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:50:42 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.776333 Nov 28 14:50:42 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 402/1202] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:50:41 2023] POST /compute/v2.1/servers => generated 404 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:50:42 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 14:50:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-9053b342-3f78-4670-b7bb-c0f8a6927e56 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:50:42 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-9053b342-3f78-4670-b7bb-c0f8a6927e56 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:50:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:42 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:42 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-9053b342-3f78-4670-b7bb-c0f8a6927e56 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:50:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-9053b342-3f78-4670-b7bb-c0f8a6927e56 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 200 len: 1086 microversion: 2.1 time: 0.082276 Nov 28 14:50:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 404/1203] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:50:42 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 1086 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:50:44 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:50:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:44 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Creating event network-changed:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:50:44 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032003 Nov 28 14:50:44 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 398/1204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:50:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "name": "network-vif-plugged", "status": "completed", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Creating event network-vif-plugged:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:50:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041730 Nov 28 14:50:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 403/1205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:50:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:50:54 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "name": "network-vif-plugged", "status": "completed", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:50:54 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:54 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:50:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:50:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:50:54 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:50:54 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47518. Nov 28 14:50:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Creating event network-vif-plugged:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:50:55 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Nov 28 14:50:55 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 405/1206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:50:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:51:32 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:51:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e7a8c856-3d47-4f10-9073-c432730e4461 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 200 len: 1440 microversion: 2.1 time: 0.297418 Nov 28 14:51:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 399/1207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:51:32 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 1440 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:52:32 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:52:32 user devstack@n-api.service[65025]: Tue Nov 28 14:52:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02/os-interface (ip 10.0.0.210) !!! Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:33 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-96b386e2-9858-4053-a590-81a736853577 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.204867 Nov 28 14:52:33 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 404/1208] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:52:32 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02/os-interface => generated 283 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:52:33 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:52:33 user devstack@n-api.service[65027]: Tue Nov 28 14:52:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 14:52:33 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:52:33 user devstack@n-api.service[65027]: Tue Nov 28 14:52:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 14:52:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:33 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:33 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:33 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Creating event network-changed:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:52:33 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048780 Nov 28 14:52:33 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 406/1209] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:52:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:33 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:34 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:52:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-f6330cb8-1228-44eb-b1e0-cb8a990daa78 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 200 len: 1440 microversion: 2.1 time: 0.230427 Nov 28 14:52:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 400/1210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:52:33 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 1440 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-307805741"}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:34 user devstack@n-api.service[65025]: INFO nova.compute.api [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Attempting to quiesce instance before volume snapshot. Nov 28 14:52:34 user devstack@n-api.service[65025]: INFO nova.compute.api [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 28 14:52:34 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Creating snapshot from volume fa43a66e-7d14-41b9-8486-7a6102750171. {{(pid=65025) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 28 14:52:36 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-47603716-6655-446a-93b6-251b41e43e35 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02/action" status: 202 len: 0 microversion: 2.1 time: 2.786426 Nov 28 14:52:36 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 405/1211] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 14:52:34 2023] POST /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02/action => generated 0 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 14:52:38 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-91168914-a9d8-4e81-9b04-fe2557f771e6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: .version_select at 0x7fedebf64e50>, body: {"keypair": {"name": "tempest-keypair-1929093933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYcGyCbGqITV7wJeMLHH7QJ73kzrnxM0QBLIPVHv6nZ3bKD95lM0KOLMPNjP+dLAiN0+UyZuKFbYCMWbEqU4RucVMSugFyioGc5mYizH3C7i2T9twWCpfWIJCmTBFLTnQ=="}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:38 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-91168914-a9d8-4e81-9b04-fe2557f771e6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:52:38 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-91168914-a9d8-4e81-9b04-fe2557f771e6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'key_pairs'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:52:38 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-91168914-a9d8-4e81-9b04-fe2557f771e6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068853 Nov 28 14:52:38 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 407/1212] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:52:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:52:39 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2088713378", "imageRef": "fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7", "flavorRef": "1", "networks": [{"uuid": "e134f287-51ba-4042-9230-b9b6754caa53"}], "security_groups": [{"name": "tempest-securitygroup--1106638311"}], "key_name": "tempest-keypair-1929093933", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:39 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] validate_networks() for [('e134f287-51ba-4042-9230-b9b6754caa53', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:52:40 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1bdf9689-6c9a-4597-a31c-2c601d2f44a4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:52:40 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.649604 Nov 28 14:52:40 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 401/1213] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:52:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:52:40 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-ba136e4b-13d4-47cb-a222-4e61591a0d85 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:52:40 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-ba136e4b-13d4-47cb-a222-4e61591a0d85 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:52:40 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-ba136e4b-13d4-47cb-a222-4e61591a0d85 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:52:40 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-ba136e4b-13d4-47cb-a222-4e61591a0d85 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 200 len: 1246 microversion: 2.1 time: 0.060781 Nov 28 14:52:40 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 406/1214] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:52:40 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 1246 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:52:42 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:42 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Creating event network-changed:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:52:42 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036045 Nov 28 14:52:42 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 408/1215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:52:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=8 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "name": "network-vif-plugged", "status": "completed", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:56 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Creating event network-vif-plugged:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:52:56 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041812 Nov 28 14:52:56 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 402/1216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:52:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "name": "network-vif-plugged", "status": "completed", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:52:58 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:52:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Creating event network-vif-plugged:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:52:58 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040836 Nov 28 14:52:58 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 407/1217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:53:30 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:53:30 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-2b85805d-e5ac-407d-9b33-4bf46eb73fb7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 200 len: 1599 microversion: 2.1 time: 0.396431 Nov 28 14:53:30 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 409/1218] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:53:30 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 1599 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:54:30 user devstack@n-api.service[65026]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:30 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:31 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-fed37d6f-b376-4601-b324-cef8778d44f4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.324598 Nov 28 14:54:31 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 403/1219] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 14:54:30 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89/os-interface => generated 282 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:54:31 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:54:31 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:54:31 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:31 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:31 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:31 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Creating event network-changed:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:54:31 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097856 Nov 28 14:54:31 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 408/1220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:54:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:31 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:32 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:54:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-4eda97f8-9bb2-4c16-a47b-cfa27c93335b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 200 len: 1599 microversion: 2.1 time: 0.255156 Nov 28 14:54:32 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 410/1221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:54:31 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 1599 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:32 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49600. Nov 28 14:54:32 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Going to try to terminate instance {{(pid=65026) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:54:32 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 204 len: 0 microversion: 2.1 time: 0.141477 Nov 28 14:54:32 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 404/1222] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:54:32 2023] DELETE /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:32 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:54:32 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-36897018-c7dc-4aaf-809c-e3bb2b90761b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 200 len: 1724 microversion: 2.1 time: 0.396408 Nov 28 14:54:32 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 409/1223] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:54:32 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:54:32 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "name": "network-vif-unplugged", "status": "completed", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:54:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:32 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Creating event network-vif-unplugged:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:54:32 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073978 Nov 28 14:54:32 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 411/1224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:54:34 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "name": "network-vif-plugged", "status": "completed", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}, {"server_uuid": "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89", "name": "network-vif-deleted", "tag": "d0fc3390-81a3-48b9-9fdf-c92a412e65af"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:54:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:54:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:54:34 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:54:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Creating event network-vif-plugged:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:54:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Creating event network-vif-deleted:d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 on user Nov 28 14:54:34 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038357 Nov 28 14:54:34 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 405/1225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:54:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=10 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 could not be found. Nov 28 14:55:22 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:55:22 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-f1f0df41-084e-46f5-9969-b05dcbcad619 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 404 len: 111 microversion: 2.1 time: 0.031949 Nov 28 14:55:22 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 410/1226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:55:22 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:55:26 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=8 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:26 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:55:26 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 204 len: 0 microversion: 2.1 time: 0.126534 Nov 28 14:55:26 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 412/1227] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:55:26 2023] DELETE /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:26 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:55:26 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-dc72400a-8d68-4ff5-bf89-83a0e1681eff tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 200 len: 1564 microversion: 2.1 time: 0.322191 Nov 28 14:55:26 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 406/1228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:55:26 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 1564 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:55:26 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "name": "network-vif-unplugged", "status": "completed", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:55:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:26 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Creating event network-vif-unplugged:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:55:26 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028459 Nov 28 14:55:26 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 411/1229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:55:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:55:28 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "name": "network-vif-plugged", "status": "completed", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}, {"server_uuid": "97bf844f-f4bd-4a41-b734-9a294b506b02", "name": "network-vif-deleted", "tag": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:55:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:55:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:55:28 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:55:28 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36244. Nov 28 14:55:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Creating event network-vif-plugged:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:55:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Creating event network-vif-deleted:c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance 97bf844f-f4bd-4a41-b734-9a294b506b02 on user Nov 28 14:55:28 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032162 Nov 28 14:55:28 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 413/1230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:55:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 could not be found. Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:56:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-a332b137-bbc0-4003-a2fa-effe05ab64af tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 404 len: 111 microversion: 2.1 time: 0.043414 Nov 28 14:56:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 407/1231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:56:16 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 could not be found. Nov 28 14:56:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:56:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d758cd59-d3ac-4c52-a1ef-1e591c5b191b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 404 len: 111 microversion: 2.1 time: 0.075464 Nov 28 14:56:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 412/1232] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:56:16 2023] DELETE /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 could not be found. Nov 28 14:56:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:56:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b5608ea2-170f-4308-8b45-fa7550e4f145 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" status: 404 len: 111 microversion: 2.1 time: 0.038040 Nov 28 14:56:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 414/1233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:56:16 2023] GET /compute/v2.1/servers/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:56:16 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e2bcd6d1-9cc2-4b6e-8d0b-abb3f09b13fe tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '.version_select at 0x7fedebf97400>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:16 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e2bcd6d1-9cc2-4b6e-8d0b-abb3f09b13fe tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929093933" status: 202 len: 0 microversion: 2.1 time: 0.025188 Nov 28 14:56:16 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 408/1234] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 14:56:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929093933 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 could not be found. Nov 28 14:56:17 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:56:17 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-b9edc841-e16f-40fa-b401-ef47bf5be8b9 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 404 len: 111 microversion: 2.1 time: 0.029984 Nov 28 14:56:17 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 413/1235] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:56:17 2023] DELETE /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 could not be found. Nov 28 14:56:17 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:56:17 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a7478365-5987-416e-9a5a-31d376f86320 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02" status: 404 len: 111 microversion: 2.1 time: 0.027750 Nov 28 14:56:17 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 415/1236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:56:17 2023] GET /compute/v2.1/servers/97bf844f-f4bd-4a41-b734-9a294b506b02 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:56:17 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-4bcf13b2-ec98-485b-a13a-5d17fab9061d tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '.version_select at 0x7fedebe36d40>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:17 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-4bcf13b2-ec98-485b-a13a-5d17fab9061d tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859234956" status: 202 len: 0 microversion: 2.1 time: 0.023132 Nov 28 14:56:17 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 409/1237] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 14:56:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859234956 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 14:56:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-188e3336-bb62-4a17-ae12-3d86ef5d4e58 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: .version_select at 0x7fedf037af80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-498211364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ=="}} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:56:18 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-188e3336-bb62-4a17-ae12-3d86ef5d4e58 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:56:18 user devstack@n-api.service[65025]: DEBUG nova.quota [None req-188e3336-bb62-4a17-ae12-3d86ef5d4e58 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'key_pairs'} {{(pid=65025) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:56:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-188e3336-bb62-4a17-ae12-3d86ef5d4e58 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.080160 Nov 28 14:56:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 414/1238] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 14:56:18 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:56:24 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1490882601", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1276799618"}], "block_device_mapping_v2": [{"uuid": "517a0ea3-4ec6-4a12-b8fb-b2241ad7a574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-498211364", "networks": [{"uuid": "e134f287-51ba-4042-9230-b9b6754caa53"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:56:24 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] validate_networks() for [('e134f287-51ba-4042-9230-b9b6754caa53', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:56:25 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='517a0ea3-4ec6-4a12-b8fb-b2241ad7a574',volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:56:25 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.167728 Nov 28 14:56:25 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 416/1239] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:56:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:56:25 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-e4826cef-bd3e-4b21-b384-a783c55ba820 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:56:25 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-e4826cef-bd3e-4b21-b384-a783c55ba820 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:56:25 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-e4826cef-bd3e-4b21-b384-a783c55ba820 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:56:25 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-e4826cef-bd3e-4b21-b384-a783c55ba820 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 200 len: 1087 microversion: 2.1 time: 0.069708 Nov 28 14:56:25 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 410/1240] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:56:25 2023] GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:56:28 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:28 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:56:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:28 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Creating event network-changed:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:56:28 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059185 Nov 28 14:56:28 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 415/1241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:56:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:56:36 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 14:56:36 user devstack@n-api.service[65027]: Tue Nov 28 14:56:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "name": "network-vif-plugged", "status": "completed", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:36 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:36 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Creating event network-vif-plugged:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:56:36 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096676 Nov 28 14:56:36 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 417/1242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:56:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "name": "network-vif-plugged", "status": "completed", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:56:38 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:56:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Creating event network-vif-plugged:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:56:38 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038748 Nov 28 14:56:38 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 411/1243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:56:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:57:16 user devstack@n-api.service[65025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:57:16 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:57:16 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-e41abf3d-9cf3-44cd-beae-547c7c76e793 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 200 len: 1440 microversion: 2.1 time: 0.232660 Nov 28 14:57:16 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 416/1244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:57:16 2023] GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 1440 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:16 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:58:16 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-a81ea206-1abe-4022-8ad0-ec38de999d19 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 200 len: 1440 microversion: 2.1 time: 0.319510 Nov 28 14:58:16 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 418/1245] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:58:16 2023] GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 1440 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:58:18 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:58:18 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:58:18 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:58:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:18 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Creating event network-changed:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:58:18 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040081 Nov 28 14:58:18 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 412/1246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:18 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57396. Nov 28 14:58:18 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 14:58:18 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 204 len: 0 microversion: 2.1 time: 0.137609 Nov 28 14:58:18 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 417/1247] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 14:58:18 2023] DELETE /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:18 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:58:18 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-957a55c1-a9f7-416c-8182-c22d8d115534 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 200 len: 1565 microversion: 2.1 time: 0.230871 Nov 28 14:58:18 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 419/1248] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:58:18 2023] GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 1565 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:58:20 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "name": "network-vif-unplugged", "status": "completed", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}, {"server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "name": "network-vif-plugged", "status": "completed", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:20 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Creating event network-vif-unplugged:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:58:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Creating event network-vif-plugged:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:58:20 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030978 Nov 28 14:58:20 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 413/1249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:58:20 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd", "name": "network-vif-deleted", "tag": "44592762-39a0-44d6-b89b-326e161d98cf"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:58:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:58:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:58:20 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:58:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] Creating event network-vif-deleted:44592762-39a0-44d6-b89b-326e161d98cf for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd on user Nov 28 14:58:20 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030796 Nov 28 14:58:20 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 418/1250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=12 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. Nov 28 14:59:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 14:59:08 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0b2236ac-308b-4cc8-86de-5d72c923d8c1 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 404 len: 111 microversion: 2.1 time: 0.045031 Nov 28 14:59:08 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 420/1251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:59:08 2023] GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 14:59:09 user devstack@n-api.service[65026]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=4 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-352957172", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1276799618"}], "block_device_mapping_v2": [{"uuid": "517a0ea3-4ec6-4a12-b8fb-b2241ad7a574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-498211364", "networks": [{"uuid": "e134f287-51ba-4042-9230-b9b6754caa53"}]}} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] validate_networks() for [('e134f287-51ba-4042-9230-b9b6754caa53', None, None, None, None, None)] {{(pid=65026) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.quota [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65026) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Going to run 1 instances... {{(pid=65026) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 14:59:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='517a0ea3-4ec6-4a12-b8fb-b2241ad7a574',volume_size=None,volume_type=None)] {{(pid=65026) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 14:59:10 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.965736 Nov 28 14:59:10 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 414/1252] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 14:59:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 14:59:10 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:10 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:10 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-2233df8c-3ac7-4ebd-b005-4dc7c53c7dc6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 14:59:10 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-2233df8c-3ac7-4ebd-b005-4dc7c53c7dc6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 14:59:10 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-2233df8c-3ac7-4ebd-b005-4dc7c53c7dc6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 14:59:10 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-2233df8c-3ac7-4ebd-b005-4dc7c53c7dc6 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14" status: 200 len: 1086 microversion: 2.1 time: 0.073770 Nov 28 14:59:10 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 419/1253] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 14:59:10 2023] GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 => generated 1086 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 14:59:12 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:59:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:12 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Creating event network-changed:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 14:59:12 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Nov 28 14:59:12 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 421/1254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "name": "network-vif-plugged", "status": "completed", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Creating event network-vif-plugged:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 14:59:22 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34728. Nov 28 14:59:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064851 Nov 28 14:59:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 415/1255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:59:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 14:59:25 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "name": "network-vif-plugged", "status": "completed", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 14:59:25 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:25 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell0:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 14:59:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 14:59:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 14:59:25 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 14:59:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Creating event network-vif-plugged:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 14:59:25 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037363 Nov 28 14:59:25 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 420/1256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 14:59:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:00:00 user devstack@n-api.service[65027]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 15:00:00 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 15:00:00 user devstack@n-api.service[65027]: Tue Nov 28 15:00:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 (ip 10.0.0.210) !!! Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=4 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:00:00 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:00:00 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-0b45bf7f-e7fa-4785-88a7-7b65394ca90b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14" status: 200 len: 1439 microversion: 2.1 time: 0.274247 Nov 28 15:00:00 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 422/1257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:00:00 2023] GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 => generated 1439 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:00 user devstack@n-api.service[65026]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:01 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:01:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-5d160c82-5bea-4a7b-9665-0f9ddfececf3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14" status: 200 len: 1439 microversion: 2.1 time: 0.540537 Nov 28 15:01:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 416/1258] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:01:00 2023] GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 => generated 1439 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:01:02 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 15:01:02 user devstack@n-api.service[65025]: Tue Nov 28 15:01:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 15:01:02 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 15:01:02 user devstack@n-api.service[65025]: Tue Nov 28 15:01:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 15:01:02 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:02 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:01:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Creating event network-changed:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 15:01:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097615 Nov 28 15:01:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 421/1259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:01:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:01:08 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 15:01:08 user devstack@n-api.service[65027]: Tue Nov 28 15:01:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 28 15:01:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:08 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:08 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-180851206", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1276799618"}], "block_device_mapping_v2": [{"uuid": "a1e8309f-4559-4e62-870a-16a3b5414df6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-498211364", "networks": [{"uuid": "e134f287-51ba-4042-9230-b9b6754caa53"}]}} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:01:08 user devstack@n-api.service[65027]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecb8051e-d7de-4f3b-a518-87467c4eb58b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50524. Nov 28 15:01:08 user devstack@n-api.service[65027]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] validate_networks() for [('e134f287-51ba-4042-9230-b9b6754caa53', None, None, None, None, None)] {{(pid=65027) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.quota [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting quotas for user ff4761ea9f664afd889cdcbda34787ad and project 193290c25f24467eac18c8a58e647834. Resources: {'cores', 'ram', 'instances'} {{(pid=65027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Going to run 1 instances... {{(pid=65027) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 15:01:09 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1e8309f-4559-4e62-870a-16a3b5414df6',volume_size=None,volume_type=None)] {{(pid=65027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 15:01:09 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.800769 Nov 28 15:01:09 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 423/1260] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 15:01:08 2023] POST /compute/v2.1/servers => generated 404 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 15:01:09 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-c07c8c1d-c0f5-4283-a73f-e16b06f3f8a0 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:01:09 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-c07c8c1d-c0f5-4283-a73f-e16b06f3f8a0 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:01:09 user devstack@n-api.service[65026]: INFO oslo.messaging._drivers.impl_rabbit [-] [d615f022-260d-4331-86c4-1b69cda30b59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50536. Nov 28 15:01:09 user devstack@n-api.service[65026]: DEBUG nova.policy [None req-c07c8c1d-c0f5-4283-a73f-e16b06f3f8a0 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65026) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:01:09 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-c07c8c1d-c0f5-4283-a73f-e16b06f3f8a0 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" status: 200 len: 1086 microversion: 2.1 time: 0.065305 Nov 28 15:01:09 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 417/1261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:01:09 2023] GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc => generated 1086 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:01:11 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:01:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:11 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Creating event network-changed:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:01:11 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029832 Nov 28 15:01:11 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 422/1262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:01:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell0:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "name": "network-vif-plugged", "status": "completed", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:20 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Creating event network-vif-plugged:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:01:20 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038503 Nov 28 15:01:20 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 424/1263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "name": "network-vif-plugged", "status": "completed", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell0:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:22 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Creating event network-vif-plugged:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:01:22 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035803 Nov 28 15:01:22 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 418/1264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:01:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:01:59 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:01:59 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-d307339d-926f-4efd-8fcd-e30c493d71ca tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" status: 200 len: 1440 microversion: 2.1 time: 0.292114 Nov 28 15:01:59 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 423/1265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:01:59 2023] GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc => generated 1440 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=2 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:02:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:00 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:03:00 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-89744b3a-b2bb-4890-a29b-ce21ef8d99e5 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" status: 200 len: 1440 microversion: 2.1 time: 0.252603 Nov 28 15:03:00 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 425/1266] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:02:59 2023] GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc => generated 1440 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:03:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:01 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=2 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:01 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:01 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Creating event network-changed:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:03:01 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097327 Nov 28 15:03:01 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 419/1267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:03:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=2 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=6 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:02 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Going to try to terminate instance {{(pid=65025) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 15:03:02 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" status: 204 len: 0 microversion: 2.1 time: 0.115979 Nov 28 15:03:02 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 424/1268] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 15:03:02 2023] DELETE /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:02 user devstack@n-api.service[65027]: DEBUG nova.policy [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65027) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:03:02 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-d45d0de9-403e-4e1b-b680-43c25f55b06c tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" status: 200 len: 1565 microversion: 2.1 time: 0.269046 Nov 28 15:03:02 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 426/1269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:03:02 2023] GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc => generated 1565 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:03:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "name": "network-vif-unplugged", "status": "completed", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:03:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Creating event network-vif-unplugged:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:03:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083210 Nov 28 15:03:02 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 420/1270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:03:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:03:03 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:03:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:03 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.compute.server_external_events [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Creating event network-changed:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:03:03 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030283 Nov 28 15:03:03 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 425/1271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:03:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:03:04 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "name": "network-vif-deleted", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:03:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:04 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] Creating event network-vif-deleted:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:03:04 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029212 Nov 28 15:03:04 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 427/1272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:03:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:03:04 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc", "name": "network-vif-plugged", "status": "completed", "tag": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:03:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:04 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Creating event network-vif-plugged:53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc on user Nov 28 15:03:04 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029909 Nov 28 15:03:04 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 421/1273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:03:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:03:52 user devstack@n-api.service[65025]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc could not be found. Nov 28 15:03:52 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 15:03:52 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-1127b91b-fd63-4e4c-891e-4cc6dec531db tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" status: 404 len: 111 microversion: 2.1 time: 0.097072 Nov 28 15:03:52 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 426/1274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:03:52 2023] GET /compute/v2.1/servers/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=6 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:59 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=14 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:59 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:03:59 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:03:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:59 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:03:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Creating event network-changed:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 15:03:59 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045599 Nov 28 15:03:59 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 422/1275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:03:59 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Going to try to terminate instance {{(pid=65027) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 15:03:59 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14" status: 204 len: 0 microversion: 2.1 time: 0.207547 Nov 28 15:03:59 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 428/1276] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 15:03:59 2023] DELETE /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:00 user devstack@n-api.service[65025]: INFO oslo.messaging._drivers.impl_rabbit [-] [e5bcb8f2-89e4-493a-a818-a878c94eba4c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37866. Nov 28 15:04:00 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "name": "network-vif-unplugged", "status": "completed", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:04:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:00 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Creating event network-vif-unplugged:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 15:04:00 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033909 Nov 28 15:04:00 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 423/1277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:04:00 user devstack@n-api.service[65025]: DEBUG nova.policy [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65025) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 15:04:00 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-0828785a-c7ee-4fb6-a1ef-8b914edb8244 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14" status: 200 len: 1564 microversion: 2.1 time: 0.427577 Nov 28 15:04:00 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 427/1278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:04:00 2023] GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 => generated 1564 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 15:04:01 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "name": "network-vif-deleted", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:04:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:01 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.compute.server_external_events [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] Creating event network-vif-deleted:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 15:04:01 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Nov 28 15:04:01 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 429/1279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:04:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:04:02 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f7954-6146-4786-8d53-348e0489ba14", "name": "network-vif-plugged", "status": "completed", "tag": "16083ebd-df26-40bd-a15a-a3ae1f2e6224"}]} {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 15:04:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:02 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.compute.server_external_events [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Creating event network-vif-plugged:16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance d78f7954-6146-4786-8d53-348e0489ba14 on user Nov 28 15:04:02 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040816 Nov 28 15:04:02 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 424/1280] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 15:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_api:SELECT=4 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG dbcounter [-] [65025] Writing DB stats nova_cell1:SELECT=8 {{(pid=65025) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG nova.compute.api [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Fetching instance by UUID {{(pid=65025) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG oslo_concurrency.lockutils [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65025) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.wsgi [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance d78f7954-6146-4786-8d53-348e0489ba14 could not be found. Nov 28 15:04:50 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance d78f7954-6146-4786-8d53-348e0489ba14 could not be found. {{(pid=65025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 15:04:50 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-c5ab67d2-6c2e-4cd1-9e94-95a064b46a8e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14" status: 404 len: 111 microversion: 2.1 time: 0.037593 Nov 28 15:04:50 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 428/1281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:04:50 2023] GET /compute/v2.1/servers/d78f7954-6146-4786-8d53-348e0489ba14 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG dbcounter [-] [65027] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65027) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG nova.compute.api [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65027) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG oslo_concurrency.lockutils [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65027) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.wsgi [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. Nov 28 15:04:51 user devstack@n-api.service[65027]: DEBUG nova.api.openstack.wsgi [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. {{(pid=65027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 15:04:51 user devstack@n-api.service[65027]: INFO nova.api.openstack.requestlog [None req-5b944ade-a1e8-4903-8926-c938284e9457 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 404 len: 111 microversion: 2.1 time: 0.042640 Nov 28 15:04:51 user devstack@n-api.service[65027]: [pid: 65027|app: 0|req: 430/1282] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 15:04:51 2023] DELETE /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_api:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG dbcounter [-] [65026] Writing DB stats nova_cell1:SELECT=6 {{(pid=65026) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '>' {{(pid=65026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG nova.compute.api [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Fetching instance by UUID {{(pid=65026) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d4cfc4cc-712b-461a-95da-c44375c58fac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG oslo_concurrency.lockutils [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d4cfc4cc-712b-461a-95da-c44375c58fac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 15:04:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.wsgi [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HTTP exception thrown: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. Nov 28 15:04:51 user devstack@n-api.service[65026]: DEBUG nova.api.openstack.wsgi [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Returning 404 to user: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. {{(pid=65026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 15:04:51 user devstack@n-api.service[65026]: INFO nova.api.openstack.requestlog [None req-eace70d9-546d-48b8-a6bb-ae0cb36d7f8b tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" status: 404 len: 111 microversion: 2.1 time: 0.042420 Nov 28 15:04:51 user devstack@n-api.service[65026]: [pid: 65026|app: 0|req: 425/1283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 15:04:51 2023] GET /compute/v2.1/servers/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 15:04:54 user devstack@n-api.service[65025]: DEBUG nova.api.openstack.wsgi [None req-771fe7d4-6a85-4e98-aa0e-e9bfaae84bd8 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Calling method '.version_select at 0x7fedf019f490>' {{(pid=65025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 15:04:54 user devstack@n-api.service[65025]: INFO nova.api.openstack.requestlog [None req-771fe7d4-6a85-4e98-aa0e-e9bfaae84bd8 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-498211364" status: 202 len: 0 microversion: 2.1 time: 0.030924 Nov 28 15:04:54 user devstack@n-api.service[65025]: [pid: 65025|app: 0|req: 429/1284] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Nov 28 15:04:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-498211364 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)